2026-03-28 19:10:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 19:10:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 19:10:05 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-28 19:10:05 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 19:10:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 19:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 19:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 19:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 19:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: c5bf70fe51ad301c
2026-03-28 19:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 19:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-28T19_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 19:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 19:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 19:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 19:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 19:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 19:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 19:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-28 19:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 19:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 19:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 19:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 19:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 19:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 19:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 19:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 19:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 19:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 19:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 19:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 19:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 19:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 19:10:16 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:16 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-28 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-28 19:10:16 [auto1.nl] INFO: Scrape type for KX21734: 2
2026-03-28 19:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734
2026-03-28 19:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with scrape type 2
2026-03-28 19:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with scrape type 2
2026-03-28 19:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 54c64ac4-0b5e-5729-9514-4ba54cee93d5, identifier: KX21734
2026-03-28 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734
2026-03-28 19:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734 to the API
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:18:09Z',
 'fuel_type': 'petrol',
 'id': '54c64ac4-0b5e-5729-9514-4ba54cee93d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX21734',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 193391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 230 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 1997}
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-28 19:10:17 [auto1.nl] INFO: Saving data for KX21734: {'auction_closing_time': 1774883889.0, 'created_time': 1773836844.423176, 'last_price_update_time': 1774725017.610105}
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX21734') HTTP/1.1" 204 0
2026-03-28 19:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:17 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-28 19:10:17 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-28 19:10:17 [auto1.nl] INFO: Scrape type for HR57884: 1
2026-03-28 19:10:17 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-28 19:10:17 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-28 19:10:17 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-28 19:10:17 [auto1.nl] INFO: Scrape type for DJ99279: 2
2026-03-28 19:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279
2026-03-28 19:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with scrape type 2
2026-03-28 19:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with scrape type 2
2026-03-28 19:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b, identifier: DJ99279
2026-03-28 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 19:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279
2026-03-28 19:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279 to the API
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:53:09Z',
 'fuel_type': 'diesel',
 'id': '78d6dc56-16a0-5e33-b4db-6c848c1a6a2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ99279',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 262161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Saving data for DJ99279: {'auction_closing_time': 1774885989.0, 'created_time': 1774033996.836276, 'last_price_update_time': 1774725018.282609}
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ99279') HTTP/1.1" 204 0
2026-03-28 19:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for LZ20154: 2
2026-03-28 19:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154
2026-03-28 19:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433a8b0d-6789-5e38-a80d-9168a57a85f3 with scrape type 2
2026-03-28 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 433a8b0d-6789-5e38-a80d-9168a57a85f3 with scrape type 2
2026-03-28 19:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 433a8b0d-6789-5e38-a80d-9168a57a85f3, identifier: LZ20154
2026-03-28 19:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154
2026-03-28 19:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154
2026-03-28 19:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154 to the API
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:29:19Z',
 'fuel_type': 'petrol',
 'id': '433a8b0d-6789-5e38-a80d-9168a57a85f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ20154',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 34201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-15',
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Cool&Sound',
 'transmission': 'manual',
 'trim': 'Cool&Sound',
 'year': 2017}
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Saving data for LZ20154: {'auction_closing_time': 1774884559.0, 'created_time': 1774034009.978285, 'last_price_update_time': 1774725018.735243}
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ20154') HTTP/1.1" 204 0
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for GW21106: 1
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for VV89778: 1
2026-03-28 19:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for XZ29701: 1
2026-03-28 19:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for UM83404: 1
2026-03-28 19:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-28 19:10:18 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-28 19:10:18 [auto1.nl] INFO: Scrape type for MR73967: 2
2026-03-28 19:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-28 19:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2cbb42c-8faf-56ac-900a-7beba7154dac with scrape type 2
2026-03-28 19:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2cbb42c-8faf-56ac-900a-7beba7154dac with scrape type 2
2026-03-28 19:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2cbb42c-8faf-56ac-900a-7beba7154dac, identifier: MR73967
2026-03-28 19:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 19:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-28 19:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967 to the API
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:59Z',
 'fuel_type': 'diesel',
 'id': 'd2cbb42c-8faf-56ac-900a-7beba7154dac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR73967',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 272668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat Edition 4Motion BlueMotion',
 'year': 2016}
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-28 19:10:19 [auto1.nl] INFO: Saving data for MR73967: {'auction_closing_time': 1774883699.0, 'created_time': 1774527045.893859, 'last_price_update_time': 1774725019.429224}
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MR73967') HTTP/1.1" 204 0
2026-03-28 19:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:19 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 19:10:19 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-28 19:10:19 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-28 19:10:19 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 19:10:19 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-28 19:10:19 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-28 19:10:19 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-28 19:10:19 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-28 19:10:19 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-28 19:10:19 [auto1.nl] INFO: Scrape type for JG46150: 2
2026-03-28 19:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-28 19:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9877e3e3-9d23-5e32-80a3-17af76d5c40c with scrape type 2
2026-03-28 19:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9877e3e3-9d23-5e32-80a3-17af76d5c40c with scrape type 2
2026-03-28 19:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9877e3e3-9d23-5e32-80a3-17af76d5c40c, identifier: JG46150
2026-03-28 19:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 19:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-28 19:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150 to the API
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:38:47Z',
 'fuel_type': 'diesel',
 'id': '9877e3e3-9d23-5e32-80a3-17af76d5c40c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG46150',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 321308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-04',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-28 19:10:20 [auto1.nl] INFO: Saving data for JG46150: {'auction_closing_time': 1774885127.0, 'created_time': 1774008646.275382, 'last_price_update_time': 1774725020.08045}
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG46150') HTTP/1.1" 204 0
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-28 19:10:20 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-28 19:10:20 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-28 19:10:20 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-28 19:10:20 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ29701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV89778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW21106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:20 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-28 19:10:20 [auto1.nl] INFO: Scrape type for KX21734: 0
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-28 19:10:20 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/HR57884/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 19:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-28 19:10:20 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-28 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for DJ99279: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for LZ20154: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-28 19:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-28 19:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-28 19:10:21 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 19:10:21 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 19:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM83404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR57884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW21106> (referer: https://www.auto1.com/v1/car-details-view/GW21106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106
2026-03-28 19:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf9f42f0-ebaa-5658-a04b-199441647e09 with scrape type 1
2026-03-28 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cf9f42f0-ebaa-5658-a04b-199441647e09
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F1d%252F0e1d2b2df6906c0b66e7b21311255330%252Fpa%252FGW21106_199ab4fc9e97e1c6345cb2783a85e04f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_199ab4fc9e97e1c6345cb2783a85e04f.jpg already downloaded
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F1d%252F0e1d2b2df6906c0b66e7b21311255330%252Fpa%252FGW21106_0b54d3db6854146594c62e909644dbf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_0b54d3db6854146594c62e909644dbf6.jpg already downloaded
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F1d%252F0e1d2b2df6906c0b66e7b21311255330%252Fpa%252FGW21106_8b504b99c3975e54179941e9873a72fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_8b504b99c3975e54179941e9873a72fa.jpg already downloaded
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F1d%252F0e1d2b2df6906c0b66e7b21311255330%252Fpa%252FGW21106_bdcc01d77020656c857a36870f2ebb71.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_bdcc01d77020656c857a36870f2ebb71.jpg already downloaded
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F1d%252F0e1d2b2df6906c0b66e7b21311255330%252Fpa%252FGW21106_6f701273fe4bb3f4cb26eec1cb75f3ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_6f701273fe4bb3f4cb26eec1cb75f3ed.jpg already downloaded
2026-03-28 19:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cf9f42f0-ebaa-5658-a04b-199441647e09, identifier: GW21106
2026-03-28 19:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 19:10:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106
2026-03-28 19:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106 to the API
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW21106>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'petrol',
 'id': 'cf9f42f0-ebaa-5658-a04b-199441647e09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '32PKBH',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW21106',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '5er',
 'odometer': 334483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_199ab4fc9e97e1c6345cb2783a85e04f.jpg',
                'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_0b54d3db6854146594c62e909644dbf6.jpg',
                'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_8b504b99c3975e54179941e9873a72fa.jpg',
                'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_bdcc01d77020656c857a36870f2ebb71.jpg',
                'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_6f701273fe4bb3f4cb26eec1cb75f3ed.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9f42f0-ebaa-5658-a04b-199441647e09/cf9f42f0-ebaa-5658-a04b-199441647e09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_199ab4fc9e97e1c6345cb2783a85e04f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9f42f0-ebaa-5658-a04b-199441647e09/cf9f42f0-ebaa-5658-a04b-199441647e09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_0b54d3db6854146594c62e909644dbf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9f42f0-ebaa-5658-a04b-199441647e09/cf9f42f0-ebaa-5658-a04b-199441647e09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_8b504b99c3975e54179941e9873a72fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9f42f0-ebaa-5658-a04b-199441647e09/cf9f42f0-ebaa-5658-a04b-199441647e09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_bdcc01d77020656c857a36870f2ebb71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf9f42f0-ebaa-5658-a04b-199441647e09/cf9f42f0-ebaa-5658-a04b-199441647e09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/1d/0e1d2b2df6906c0b66e7b21311255330/pa/GW21106_6f701273fe4bb3f4cb26eec1cb75f3ed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-28 19:10:22 [auto1.nl] INFO: Saving data for GW21106: {'created_time': 1774725022.955894, 'last_price_update_time': 1774725022.955906, 'auction_closing_time': 1774883687.0}
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW21106') HTTP/1.1" 204 0
2026-03-28 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV89778> (referer: https://www.auto1.com/v1/car-details-view/VV89778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM83404> (referer: https://www.auto1.com/v1/car-details-view/UM83404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ29701> (referer: https://www.auto1.com/v1/car-details-view/XZ29701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR57884> (referer: https://www.auto1.com/v1/car-details-view/HR57884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:23 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for SV00912: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for AX06352: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for YT76844: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD02824%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for XD02824: 1
2026-03-28 19:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for AX28541: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-28 19:10:23 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Scrape type for NR59954: 2
2026-03-28 19:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-28 19:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-28 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-28 19:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a57a418-7494-5caa-99bb-22f2e88a16d7, identifier: NR59954
2026-03-28 19:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-28 19:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-28 19:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954 to the API
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:55:21Z',
 'fuel_type': 'petrol',
 'id': '8a57a418-7494-5caa-99bb-22f2e88a16d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR59954',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 319215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Volvo V70 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2012}
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [auto1.nl] INFO: Saving data for NR59954: {'auction_closing_time': 1774886121.0, 'created_time': 1773232326.378528, 'last_price_update_time': 1774725023.808957}
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR59954') HTTP/1.1" 204 0
2026-03-28 19:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778
2026-03-28 19:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with scrape type 1
2026-03-28 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_5203ce9758cb765f1f4fcbc800d54eb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_5203ce9758cb765f1f4fcbc800d54eb4.jpg already downloaded
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_c3df2a09ba0fca8ff44c6c51ad81ff78.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_c3df2a09ba0fca8ff44c6c51ad81ff78.jpg already downloaded
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_1023f3949379c7d5d22da7aaad0ca2bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_1023f3949379c7d5d22da7aaad0ca2bb.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_56c8f27882012d4d733490078af30665.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_56c8f27882012d4d733490078af30665.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_7d8472fe6c5170489c5f7ed088a88083.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_7d8472fe6c5170489c5f7ed088a88083.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_259b2c6d8e8ac4696e4d82b576b831a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_259b2c6d8e8ac4696e4d82b576b831a6.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_af3c3fcfca600fac1873e2638fbd3474.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_af3c3fcfca600fac1873e2638fbd3474.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_50593e63924b5787d3b846b8603d2df2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_50593e63924b5787d3b846b8603d2df2.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_c3f967f84f5e906162a1e66f17b4fe9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_c3f967f84f5e906162a1e66f17b4fe9d.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F57%252Fa657fe0e5d7804f3ad63c03e33a16b2d%252Fpa%252FVV89778_ac4adea65f6e04014003bf9ad113532e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_ac4adea65f6e04014003bf9ad113532e.jpg already downloaded
2026-03-28 19:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc, identifier: VV89778
2026-03-28 19:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404
2026-03-28 19:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5511b9b-4aa7-5b7d-93d2-01505a00d69e with scrape type 1
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5511b9b-4aa7-5b7d-93d2-01505a00d69e
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_a5558907d76b603f463d1fb491c19ef5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_a5558907d76b603f463d1fb491c19ef5.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_631260efd5ee4daedc79f288aa7b512d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_631260efd5ee4daedc79f288aa7b512d.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_696c41abc0f646af25edcfcdcf7811f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_696c41abc0f646af25edcfcdcf7811f8.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_56e0e5b85d511e5df56e901a89a39f76.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_56e0e5b85d511e5df56e901a89a39f76.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_7e372321578de4ae078ef773f247709e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_7e372321578de4ae078ef773f247709e.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_f9aa864179ba47b77f243794314e1c2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_f9aa864179ba47b77f243794314e1c2b.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_87a86738d5d8fa8f2760222e830c409d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_87a86738d5d8fa8f2760222e830c409d.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_e782f8cf3363f8b386ad4540de12ba1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_e782f8cf3363f8b386ad4540de12ba1d.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_8d1934e137c82dcd43b6703505c9a0a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_8d1934e137c82dcd43b6703505c9a0a9.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F06%252F81067a016ce68c9238a7870560a2b266%252Fpa%252FUM83404_18193cff306f78f35c198423a1495e1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_18193cff306f78f35c198423a1495e1c.jpg already downloaded
2026-03-28 19:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5511b9b-4aa7-5b7d-93d2-01505a00d69e, identifier: UM83404
2026-03-28 19:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701
2026-03-28 19:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf99c3c-1725-5f90-ad00-8ba61533ca0e with scrape type 1
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item daf99c3c-1725-5f90-ad00-8ba61533ca0e
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff2%252Fb4f236dacf320d2a230fe0abf3e6cd43%252Fpa%252FXZ29701_09310704896b2ae3403e190be190792e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_09310704896b2ae3403e190be190792e.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff2%252Fb4f236dacf320d2a230fe0abf3e6cd43%252Fpa%252FXZ29701_f299b9b2ce38fc5acd667dfa47a0f417.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_f299b9b2ce38fc5acd667dfa47a0f417.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff2%252Fb4f236dacf320d2a230fe0abf3e6cd43%252Fpa%252FXZ29701_a20ceda3c8068997b79be8b31dd21322.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_a20ceda3c8068997b79be8b31dd21322.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff2%252Fb4f236dacf320d2a230fe0abf3e6cd43%252Fpa%252FXZ29701_671982351f973cd4b1f44eaa1fd87fab.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_671982351f973cd4b1f44eaa1fd87fab.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Ff2%252Fb4f236dacf320d2a230fe0abf3e6cd43%252Fpa%252FXZ29701_066a2ca5fa4c248e97f9e08441c3135c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_066a2ca5fa4c248e97f9e08441c3135c.jpg already downloaded
2026-03-28 19:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: daf99c3c-1725-5f90-ad00-8ba61533ca0e, identifier: XZ29701
2026-03-28 19:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884
2026-03-28 19:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 594679ef-3f4f-5c64-a3c4-18c061a1f17e with scrape type 1
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 594679ef-3f4f-5c64-a3c4-18c061a1f17e
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_d2847fb1ecb4ff27dd3b651d4f6cc8c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_d2847fb1ecb4ff27dd3b651d4f6cc8c7.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_8e294a266cb771cfb743cbed91f9d263.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_8e294a266cb771cfb743cbed91f9d263.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_4e42765220cd665dde6a3896b54d0e85.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_4e42765220cd665dde6a3896b54d0e85.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_67e137e5c7292f36bf63350a69dc40b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_67e137e5c7292f36bf63350a69dc40b0.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_e1eb53f2ae47be7a56f1cf4f3170704f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_e1eb53f2ae47be7a56f1cf4f3170704f.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_d7fea04cefaba1b96025bbef7adc882e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_d7fea04cefaba1b96025bbef7adc882e.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_05aa40f2e98df25c3e479b9cbdd1b95a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_05aa40f2e98df25c3e479b9cbdd1b95a.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_8993832061204851919193fd91fefad5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_8993832061204851919193fd91fefad5.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_cae55ded7ec812968b2c7efc4178fc51.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_cae55ded7ec812968b2c7efc4178fc51.jpg already downloaded
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F9c%252F2c9c9693a16c4cba1f525d2687477b80%252Fpa%252FHR57884_720d6d3513018ea5f319b971d30702cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_720d6d3513018ea5f319b971d30702cc.jpg already downloaded
2026-03-28 19:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 594679ef-3f4f-5c64-a3c4-18c061a1f17e, identifier: HR57884
2026-03-28 19:10:24 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-28 19:10:24 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 19:10:24 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 19:10:24 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-28 19:10:24 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-28 19:10:24 [auto1.nl] INFO: Scrape type for KB59261: 2
2026-03-28 19:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-28 19:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with scrape type 2
2026-03-28 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with scrape type 2
2026-03-28 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34f5884b-19d6-5769-8ee9-afca53ae5eb6, identifier: KB59261
2026-03-28 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778
2026-03-28 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778
2026-03-28 19:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778 to the API
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV89778>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:19Z',
 'fuel_type': 'petrol',
 'id': '9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'J414NT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV89778',
 'listing': 'auction',
 'location': 'NL, Sittard',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 208738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 24,
 'photo_urls': ['https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_5203ce9758cb765f1f4fcbc800d54eb4.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_c3df2a09ba0fca8ff44c6c51ad81ff78.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_1023f3949379c7d5d22da7aaad0ca2bb.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_56c8f27882012d4d733490078af30665.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_7d8472fe6c5170489c5f7ed088a88083.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_259b2c6d8e8ac4696e4d82b576b831a6.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_af3c3fcfca600fac1873e2638fbd3474.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_50593e63924b5787d3b846b8603d2df2.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_c3f967f84f5e906162a1e66f17b4fe9d.jpg',
                'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_ac4adea65f6e04014003bf9ad113532e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_5203ce9758cb765f1f4fcbc800d54eb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_c3df2a09ba0fca8ff44c6c51ad81ff78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_1023f3949379c7d5d22da7aaad0ca2bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_56c8f27882012d4d733490078af30665.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_7d8472fe6c5170489c5f7ed088a88083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_259b2c6d8e8ac4696e4d82b576b831a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_af3c3fcfca600fac1873e2638fbd3474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_50593e63924b5787d3b846b8603d2df2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_c3f967f84f5e906162a1e66f17b4fe9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc/9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/57/a657fe0e5d7804f3ad63c03e33a16b2d/pa/VV89778_ac4adea65f6e04014003bf9ad113532e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-28 19:10:25 [auto1.nl] INFO: Saving data for VV89778: {'created_time': 1774725025.426583, 'last_price_update_time': 1774725025.426595, 'auction_closing_time': 1774886239.0}
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV89778') HTTP/1.1" 204 0
2026-03-28 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404
2026-03-28 19:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404 to the API
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UM83404>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:25:07Z',
 'fuel_type': 'hybrid',
 'id': 'f5511b9b-4aa7-5b7d-93d2-01505a00d69e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'J504TS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM83404',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 48827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_a5558907d76b603f463d1fb491c19ef5.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_631260efd5ee4daedc79f288aa7b512d.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_696c41abc0f646af25edcfcdcf7811f8.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_56e0e5b85d511e5df56e901a89a39f76.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_7e372321578de4ae078ef773f247709e.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_f9aa864179ba47b77f243794314e1c2b.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_87a86738d5d8fa8f2760222e830c409d.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_e782f8cf3363f8b386ad4540de12ba1d.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_8d1934e137c82dcd43b6703505c9a0a9.jpg',
                'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_18193cff306f78f35c198423a1495e1c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847132,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_a5558907d76b603f463d1fb491c19ef5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2923125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_631260efd5ee4daedc79f288aa7b512d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541773,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_696c41abc0f646af25edcfcdcf7811f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_56e0e5b85d511e5df56e901a89a39f76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2513407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_7e372321578de4ae078ef773f247709e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_f9aa864179ba47b77f243794314e1c2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_87a86738d5d8fa8f2760222e830c409d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_e782f8cf3363f8b386ad4540de12ba1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2837843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_8d1934e137c82dcd43b6703505c9a0a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5511b9b-4aa7-5b7d-93d2-01505a00d69e/f5511b9b-4aa7-5b7d-93d2-01505a00d69e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/06/81067a016ce68c9238a7870560a2b266/pa/UM83404_18193cff306f78f35c198423a1495e1c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2020}
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-28 19:10:25 [auto1.nl] INFO: Saving data for UM83404: {'created_time': 1774725025.981621, 'last_price_update_time': 1774725025.98163, 'auction_closing_time': 1774884307.0}
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UM83404') HTTP/1.1" 204 0
2026-03-28 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701
2026-03-28 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701
2026-03-28 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701 to the API
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XZ29701>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:33Z',
 'fuel_type': 'petrol',
 'id': 'daf99c3c-1725-5f90-ad00-8ba61533ca0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '00KPX3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ29701',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 239612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_09310704896b2ae3403e190be190792e.jpg',
                'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_f299b9b2ce38fc5acd667dfa47a0f417.jpg',
                'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_a20ceda3c8068997b79be8b31dd21322.jpg',
                'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_671982351f973cd4b1f44eaa1fd87fab.jpg',
                'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_066a2ca5fa4c248e97f9e08441c3135c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf99c3c-1725-5f90-ad00-8ba61533ca0e/daf99c3c-1725-5f90-ad00-8ba61533ca0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_09310704896b2ae3403e190be190792e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf99c3c-1725-5f90-ad00-8ba61533ca0e/daf99c3c-1725-5f90-ad00-8ba61533ca0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_f299b9b2ce38fc5acd667dfa47a0f417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf99c3c-1725-5f90-ad00-8ba61533ca0e/daf99c3c-1725-5f90-ad00-8ba61533ca0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_a20ceda3c8068997b79be8b31dd21322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf99c3c-1725-5f90-ad00-8ba61533ca0e/daf99c3c-1725-5f90-ad00-8ba61533ca0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_671982351f973cd4b1f44eaa1fd87fab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf99c3c-1725-5f90-ad00-8ba61533ca0e/daf99c3c-1725-5f90-ad00-8ba61533ca0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/f2/b4f236dacf320d2a230fe0abf3e6cd43/pa/XZ29701_066a2ca5fa4c248e97f9e08441c3135c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2010}
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-28 19:10:26 [auto1.nl] INFO: Saving data for XZ29701: {'created_time': 1774725026.298514, 'last_price_update_time': 1774725026.298524, 'auction_closing_time': 1774886013.0}
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XZ29701') HTTP/1.1" 204 0
2026-03-28 19:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884
2026-03-28 19:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884
2026-03-28 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884 to the API
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HR57884>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:18:02Z',
 'fuel_type': 'diesel',
 'id': '594679ef-3f4f-5c64-a3c4-18c061a1f17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TJ871P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR57884',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '1er',
 'odometer': 188343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_d2847fb1ecb4ff27dd3b651d4f6cc8c7.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_8e294a266cb771cfb743cbed91f9d263.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_4e42765220cd665dde6a3896b54d0e85.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_67e137e5c7292f36bf63350a69dc40b0.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_e1eb53f2ae47be7a56f1cf4f3170704f.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_d7fea04cefaba1b96025bbef7adc882e.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_05aa40f2e98df25c3e479b9cbdd1b95a.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_8993832061204851919193fd91fefad5.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_cae55ded7ec812968b2c7efc4178fc51.jpg',
                'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_720d6d3513018ea5f319b971d30702cc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_d2847fb1ecb4ff27dd3b651d4f6cc8c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667629,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_8e294a266cb771cfb743cbed91f9d263.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_4e42765220cd665dde6a3896b54d0e85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_67e137e5c7292f36bf63350a69dc40b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2547433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_e1eb53f2ae47be7a56f1cf4f3170704f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_d7fea04cefaba1b96025bbef7adc882e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_05aa40f2e98df25c3e479b9cbdd1b95a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_8993832061204851919193fd91fefad5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_cae55ded7ec812968b2c7efc4178fc51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594679ef-3f4f-5c64-a3c4-18c061a1f17e/594679ef-3f4f-5c64-a3c4-18c061a1f17e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/9c/2c9c9693a16c4cba1f525d2687477b80/pa/HR57884_720d6d3513018ea5f319b971d30702cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2013}
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-28 19:10:26 [auto1.nl] INFO: Saving data for HR57884: {'created_time': 1774725026.63043, 'last_price_update_time': 1774725026.630441, 'auction_closing_time': 1774883882.0}
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HR57884') HTTP/1.1" 204 0
2026-03-28 19:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-28 19:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-28 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261 to the API
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:37:55Z',
 'fuel_type': 'petrol',
 'id': '34f5884b-19d6-5769-8ee9-afca53ae5eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB59261',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 139006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-28 19:10:26 [auto1.nl] INFO: Saving data for KB59261: {'auction_closing_time': 1774885075.0, 'created_time': 1774527030.607707, 'last_price_update_time': 1774725026.955246}
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB59261') HTTP/1.1" 204 0
2026-03-28 19:10:26 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 19:10:26 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-28 19:10:26 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-28 19:10:26 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-28 19:10:27 [auto1.nl] INFO: Scrape type for MD55137: 2
2026-03-28 19:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-28 19:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a92613-fb03-5e07-94a5-f24ca2302e7e with scrape type 2
2026-03-28 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a92613-fb03-5e07-94a5-f24ca2302e7e with scrape type 2
2026-03-28 19:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2a92613-fb03-5e07-94a5-f24ca2302e7e, identifier: MD55137
2026-03-28 19:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-28 19:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-28 19:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137 to the API
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'petrol',
 'id': 'd2a92613-fb03-5e07-94a5-f24ca2302e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD55137',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 103056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'BMW X2 sDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-28 19:10:27 [auto1.nl] INFO: Saving data for MD55137: {'auction_closing_time': 1774886205.0, 'created_time': 1774527090.69407, 'last_price_update_time': 1774725027.388086}
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD55137') HTTP/1.1" 204 0
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-28 19:10:27 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-28 19:10:27 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-28 19:10:27 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 19:10:27 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-28 19:10:27 [auto1.nl] INFO: Scrape type for MZ48021: 0
2026-03-28 19:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD02824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:28 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-28 19:10:28 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-28 19:10:28 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-28 19:10:28 [auto1.nl] INFO: Scrape type for RC74760: 0
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 19:10:28 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-28 19:10:28 [auto1.nl] INFO: Scrape type for VL07732: 2
2026-03-28 19:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-28 19:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f516a972-b818-568f-b830-99740ff1df52 with scrape type 2
2026-03-28 19:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f516a972-b818-568f-b830-99740ff1df52 with scrape type 2
2026-03-28 19:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f516a972-b818-568f-b830-99740ff1df52, identifier: VL07732
2026-03-28 19:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 19:10:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-28 19:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732 to the API
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:13:39Z',
 'fuel_type': 'petrol',
 'id': 'f516a972-b818-568f-b830-99740ff1df52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL07732',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 246337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-28 19:10:29 [auto1.nl] INFO: Saving data for VL07732: {'auction_closing_time': 1774883619.0, 'created_time': 1774527083.562605, 'last_price_update_time': 1774725029.240877}
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL07732') HTTP/1.1" 204 0
2026-03-28 19:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:29 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-28 19:10:29 [auto1.nl] INFO: Scrape type for RX80263: 0
2026-03-28 19:10:29 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-28 19:10:29 [auto1.nl] INFO: Scrape type for GL59810: 2
2026-03-28 19:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-28 19:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a61d4a81-1529-5666-b186-c114766bf705 with scrape type 2
2026-03-28 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a61d4a81-1529-5666-b186-c114766bf705 with scrape type 2
2026-03-28 19:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a61d4a81-1529-5666-b186-c114766bf705, identifier: GL59810
2026-03-28 19:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-28 19:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-28 19:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810 to the API
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:47Z',
 'fuel_type': 'petrol',
 'id': 'a61d4a81-1529-5666-b186-c114766bf705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL59810',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 155938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-28 19:10:29 [auto1.nl] INFO: Saving data for GL59810: {'auction_closing_time': 1774883147.0, 'created_time': 1773924411.943258, 'last_price_update_time': 1774725029.738947}
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GL59810') HTTP/1.1" 204 0
2026-03-28 19:10:29 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-28 19:10:29 [auto1.nl] INFO: Scrape type for DG66253: 2
2026-03-28 19:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-28 19:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with scrape type 2
2026-03-28 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with scrape type 2
2026-03-28 19:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454, identifier: DG66253
2026-03-28 19:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-28 19:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-28 19:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253 to the API
2026-03-28 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:02:10Z',
 'fuel_type': 'petrol',
 'id': '8e8a9c89-27ee-537c-b1cf-a226e6ae2454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG66253',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 178248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-19',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Saving data for DG66253: {'auction_closing_time': 1774882930.0, 'created_time': 1774527055.729414, 'last_price_update_time': 1774725030.148736}
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG66253') HTTP/1.1" 204 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for GD99184: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for EY85081: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for FK48987: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for FP18275: 0
2026-03-28 19:10:30 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-28 19:10:30 [auto1.nl] INFO: Scrape type for BV58634: 0
2026-03-28 19:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD02824> (referer: https://www.auto1.com/v1/car-details-view/XD02824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824
2026-03-28 19:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d564dc-fabd-569c-871d-bd47aea14bed with scrape type 1
2026-03-28 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 83d564dc-fabd-569c-871d-bd47aea14bed
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fe2%252F99e2eabe811d12beaa966f697d32cd25%252Fpa%252FXD02824_5612f5f50f5cfa9a5a07914e5f9ebfa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_5612f5f50f5cfa9a5a07914e5f9ebfa1.jpg already downloaded
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fe2%252F99e2eabe811d12beaa966f697d32cd25%252Fpa%252FXD02824_a46fa752aa10317be5699a0561a01fd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_a46fa752aa10317be5699a0561a01fd2.jpg already downloaded
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fe2%252F99e2eabe811d12beaa966f697d32cd25%252Fpa%252FXD02824_cee2b46ce275d9b084d239eb6d34b2b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_cee2b46ce275d9b084d239eb6d34b2b6.jpg already downloaded
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fe2%252F99e2eabe811d12beaa966f697d32cd25%252Fpa%252FXD02824_56af9f7f65f585d7f6ee2d6d10b05dab.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_56af9f7f65f585d7f6ee2d6d10b05dab.jpg already downloaded
2026-03-28 19:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83d564dc-fabd-569c-871d-bd47aea14bed, identifier: XD02824
2026-03-28 19:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824
2026-03-28 19:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824
2026-03-28 19:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824 to the API
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD02824>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:39:44Z',
 'fuel_type': 'petrol',
 'id': '83d564dc-fabd-569c-871d-bd47aea14bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '71HJN8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD02824',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 168250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_5612f5f50f5cfa9a5a07914e5f9ebfa1.jpg',
                'https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_a46fa752aa10317be5699a0561a01fd2.jpg',
                'https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_cee2b46ce275d9b084d239eb6d34b2b6.jpg',
                'https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_56af9f7f65f585d7f6ee2d6d10b05dab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d564dc-fabd-569c-871d-bd47aea14bed/83d564dc-fabd-569c-871d-bd47aea14bed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_5612f5f50f5cfa9a5a07914e5f9ebfa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d564dc-fabd-569c-871d-bd47aea14bed/83d564dc-fabd-569c-871d-bd47aea14bed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_a46fa752aa10317be5699a0561a01fd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d564dc-fabd-569c-871d-bd47aea14bed/83d564dc-fabd-569c-871d-bd47aea14bed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_cee2b46ce275d9b084d239eb6d34b2b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83d564dc-fabd-569c-871d-bd47aea14bed/83d564dc-fabd-569c-871d-bd47aea14bed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/e2/99e2eabe811d12beaa966f697d32cd25/pa/XD02824_56af9f7f65f585d7f6ee2d6d10b05dab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.3 Duratec Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD02824%27 HTTP/1.1" 200 None
2026-03-28 19:10:31 [auto1.nl] INFO: Saving data for XD02824: {'created_time': 1774725031.777492, 'last_price_update_time': 1774725031.777507, 'auction_closing_time': 1774885184.0}
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD02824') HTTP/1.1" 204 0
2026-03-28 19:10:31 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:31 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-28 19:10:31 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-28 19:10:31 [auto1.nl] INFO: Scrape type for JM47469: 2
2026-03-28 19:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-28 19:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da668c5-d576-5a87-9220-bd2dd3339164 with scrape type 2
2026-03-28 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da668c5-d576-5a87-9220-bd2dd3339164 with scrape type 2
2026-03-28 19:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0da668c5-d576-5a87-9220-bd2dd3339164, identifier: JM47469
2026-03-28 19:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-28 19:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-28 19:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469 to the API
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 270,
 'expiration_date': '2026-03-30T15:26:00Z',
 'fuel_type': 'petrol',
 'id': '0da668c5-d576-5a87-9220-bd2dd3339164',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM47469',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 181452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI R',
 'transmission': 'automatic',
 'trim': 'R',
 'year': 2011}
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Saving data for JM47469: {'auction_closing_time': 1774884360.0, 'created_time': 1773924169.410504, 'last_price_update_time': 1774725032.27132}
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM47469') HTTP/1.1" 204 0
2026-03-28 19:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for FL63517: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for WP95967: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for ZL63379: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for MW60386: 1
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for CM00428: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for FJ00169: 2
2026-03-28 19:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-28 19:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with scrape type 2
2026-03-28 19:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with scrape type 2
2026-03-28 19:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6fdcb6b-feb2-5129-9cd6-89a41582fd14, identifier: FJ00169
2026-03-28 19:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-28 19:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-28 19:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169 to the API
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:06Z',
 'fuel_type': 'diesel',
 'id': 'd6fdcb6b-feb2-5129-9cd6-89a41582fd14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ00169',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 170008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2020}
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Saving data for FJ00169: {'auction_closing_time': 1774886226.0, 'created_time': 1774527062.760754, 'last_price_update_time': 1774725032.830723}
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ00169') HTTP/1.1" 204 0
2026-03-28 19:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-28 19:10:32 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-28 19:10:32 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-28 19:10:33 [auto1.nl] INFO: Scrape type for CR31925: 0
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-28 19:10:33 [auto1.nl] INFO: Scrape type for UR99157: 0
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-28 19:10:33 [auto1.nl] INFO: Scrape type for ZX00670: 2
2026-03-28 19:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-28 19:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09fb35d5-3846-5eec-80ae-148ce1f277a3 with scrape type 2
2026-03-28 19:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09fb35d5-3846-5eec-80ae-148ce1f277a3 with scrape type 2
2026-03-28 19:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 09fb35d5-3846-5eec-80ae-148ce1f277a3, identifier: ZX00670
2026-03-28 19:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-28 19:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-28 19:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670 to the API
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:41:32Z',
 'fuel_type': 'petrol',
 'id': '09fb35d5-3846-5eec-80ae-148ce1f277a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX00670',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 104119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-07',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-28 19:10:33 [auto1.nl] INFO: Saving data for ZX00670: {'auction_closing_time': 1774885292.0, 'created_time': 1774527030.190597, 'last_price_update_time': 1774725033.42618}
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZX00670') HTTP/1.1" 204 0
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-28 19:10:33 [auto1.nl] INFO: Scrape type for NP69601: 0
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-28 19:10:33 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 19:10:33 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-28 19:10:33 [auto1.nl] INFO: Scrape type for NR15886: 0
2026-03-28 19:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:34 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for YZ85937: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for UY18740: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for UJ05110: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for RP15329: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for BY94157: 0
2026-03-28 19:10:34 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-28 19:10:34 [auto1.nl] INFO: Scrape type for VD56637: 2
2026-03-28 19:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-28 19:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e083aad3-7d95-5383-a11e-66a3df59ba04 with scrape type 2
2026-03-28 19:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e083aad3-7d95-5383-a11e-66a3df59ba04 with scrape type 2
2026-03-28 19:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e083aad3-7d95-5383-a11e-66a3df59ba04, identifier: VD56637
2026-03-28 19:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-28 19:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-28 19:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637 to the API
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:55Z',
 'fuel_type': 'petrol',
 'id': 'e083aad3-7d95-5383-a11e-66a3df59ba04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD56637',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 69047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2020}
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-28 19:10:35 [auto1.nl] INFO: Saving data for VD56637: {'auction_closing_time': 1774885135.0, 'created_time': 1774527026.955858, 'last_price_update_time': 1774725035.253625}
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD56637') HTTP/1.1" 204 0
2026-03-28 19:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:35 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-28 19:10:35 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-28 19:10:35 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-28 19:10:35 [auto1.nl] INFO: Scrape type for WX34396: 2
2026-03-28 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-28 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with scrape type 2
2026-03-28 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with scrape type 2
2026-03-28 19:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca912cb0-dad5-54f1-afe8-fd69f13b23b9, identifier: WX34396
2026-03-28 19:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-28 19:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-28 19:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396 to the API
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'petrol',
 'id': 'ca912cb0-dad5-54f1-afe8-fd69f13b23b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX34396',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 201587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-23',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-28 19:10:35 [auto1.nl] INFO: Saving data for WX34396: {'auction_closing_time': 1774884205.0, 'created_time': 1773132428.349442, 'last_price_update_time': 1774725035.779975}
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WX34396') HTTP/1.1" 204 0
2026-03-28 19:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW60386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:35 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 19:10:35 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-28 19:10:35 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-28 19:10:35 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-28 19:10:35 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-28 19:10:35 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-28 19:10:35 [auto1.nl] INFO: Scrape type for YP25238: 2
2026-03-28 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-28 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5709728-0d97-54c9-b0dc-28a10eeef62f with scrape type 2
2026-03-28 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5709728-0d97-54c9-b0dc-28a10eeef62f with scrape type 2
2026-03-28 19:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a5709728-0d97-54c9-b0dc-28a10eeef62f, identifier: YP25238
2026-03-28 19:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-28 19:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-28 19:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238 to the API
2026-03-28 19:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:31:45Z',
 'fuel_type': 'petrol',
 'id': 'a5709728-0d97-54c9-b0dc-28a10eeef62f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP25238',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 142860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-28 19:10:36 [auto1.nl] INFO: Saving data for YP25238: {'auction_closing_time': 1774884705.0, 'created_time': 1774527040.493971, 'last_price_update_time': 1774725036.216715}
2026-03-28 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YP25238') HTTP/1.1" 204 0
2026-03-28 19:10:36 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 19:10:36 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 19:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:37 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for HD17412: 0
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for ES69537: 0
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for GN05115: 0
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for CT54062: 2
2026-03-28 19:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-28 19:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-28 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-28 19:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1158f01-7d72-5e4e-a742-1f164b3c10f0, identifier: CT54062
2026-03-28 19:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 19:10:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-28 19:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062 to the API
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:18:07Z',
 'fuel_type': 'petrol',
 'id': 'c1158f01-7d72-5e4e-a742-1f164b3c10f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54062',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 25088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2023}
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Saving data for CT54062: {'auction_closing_time': 1774883887.0, 'created_time': 1773232326.734161, 'last_price_update_time': 1774725037.841752}
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT54062') HTTP/1.1" 204 0
2026-03-28 19:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for RY75066: 0
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-28 19:10:37 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 19:10:37 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Scrape type for WK29789: 0
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Scrape type for KV87922: 0
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Scrape type for EL29526: 0
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Scrape type for CP17463: 2
2026-03-28 19:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-28 19:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with scrape type 2
2026-03-28 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with scrape type 2
2026-03-28 19:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e, identifier: CP17463
2026-03-28 19:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-28 19:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-28 19:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463 to the API
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:08Z',
 'fuel_type': 'petrol',
 'id': '7d8c1458-b76f-53bf-a51d-32c1a8a1c61e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP17463',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 67884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-06',
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Saving data for CP17463: {'auction_closing_time': 1774883708.0, 'created_time': 1774527050.199928, 'last_price_update_time': 1774725038.429932}
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP17463') HTTP/1.1" 204 0
2026-03-28 19:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW60386> (referer: https://www.auto1.com/v1/car-details-view/MW60386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Scrape type for SM80467: 2
2026-03-28 19:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-28 19:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with scrape type 2
2026-03-28 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with scrape type 2
2026-03-28 19:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c, identifier: SM80467
2026-03-28 19:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-28 19:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-28 19:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467 to the API
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:49:56Z',
 'fuel_type': 'diesel',
 'id': '3f328af6-a62d-5d37-9d2d-d0a0ad71628c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM80467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 144623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 213 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Saving data for SM80467: {'auction_closing_time': 1774885796.0, 'created_time': 1774527068.884699, 'last_price_update_time': 1774725038.949878}
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SM80467') HTTP/1.1" 204 0
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-28 19:10:38 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-28 19:10:38 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for DB11708: 0
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX51139%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for PX51139: 2
2026-03-28 19:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139
2026-03-28 19:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ff2179-b296-5132-8512-40ad03981452 with scrape type 2
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50ff2179-b296-5132-8512-40ad03981452 with scrape type 2
2026-03-28 19:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 50ff2179-b296-5132-8512-40ad03981452, identifier: PX51139
2026-03-28 19:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139
2026-03-28 19:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139
2026-03-28 19:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139 to the API
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:16Z',
 'fuel_type': 'diesel',
 'id': '50ff2179-b296-5132-8512-40ad03981452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX51139',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 37980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-13',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Kasten BlueMotion',
 'year': 2019}
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX51139%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Saving data for PX51139: {'auction_closing_time': 1774885336.0, 'created_time': 1774033840.576853, 'last_price_update_time': 1774725039.378177}
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PX51139') HTTP/1.1" 204 0
2026-03-28 19:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386
2026-03-28 19:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with scrape type 1
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_fc75e25b1f3e1cb2bf14d0758b5e10fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_fc75e25b1f3e1cb2bf14d0758b5e10fe.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_80ac2c282679e177a41a6eae14f0cfb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_80ac2c282679e177a41a6eae14f0cfb1.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_c28b0b6d7865973a1c03f3eae2bb803d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_c28b0b6d7865973a1c03f3eae2bb803d.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_e5b002e3b2d31658aae7e1759e75d1d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_e5b002e3b2d31658aae7e1759e75d1d5.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_9060b976636b6929f2b5f9dfa8b9bc80.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_9060b976636b6929f2b5f9dfa8b9bc80.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_abd21fb3b76e090ce8b7942af08dec4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_abd21fb3b76e090ce8b7942af08dec4b.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_ad8d45d7f20c1fd812fbedbb2718b19d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_ad8d45d7f20c1fd812fbedbb2718b19d.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_fa7505d82c25e3b466ff017834cf0474.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_fa7505d82c25e3b466ff017834cf0474.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_f4cb14959d1a9289f94d997e63617dc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_f4cb14959d1a9289f94d997e63617dc2.jpg already downloaded
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6a%252F766af78fe3c60c6369b2846529e1a4f9%252Fpa%252FMW60386_98f9fad958236ef4ca2e16fc3bfe9c44.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_98f9fad958236ef4ca2e16fc3bfe9c44.jpg already downloaded
2026-03-28 19:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c, identifier: MW60386
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for TW55830: 0
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for BU16200: 0
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for PA43644: 0
2026-03-28 19:10:39 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-28 19:10:39 [auto1.nl] INFO: Scrape type for HC58225: 0
2026-03-28 19:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386
2026-03-28 19:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386
2026-03-28 19:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386 to the API
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW60386>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:51Z',
 'fuel_type': 'petrol',
 'id': 'bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H291GT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW60386',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'MINI',
 'model': 'Roadster',
 'odometer': 201161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_fc75e25b1f3e1cb2bf14d0758b5e10fe.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_80ac2c282679e177a41a6eae14f0cfb1.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_c28b0b6d7865973a1c03f3eae2bb803d.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_e5b002e3b2d31658aae7e1759e75d1d5.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_9060b976636b6929f2b5f9dfa8b9bc80.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_abd21fb3b76e090ce8b7942af08dec4b.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_ad8d45d7f20c1fd812fbedbb2718b19d.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_fa7505d82c25e3b466ff017834cf0474.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_f4cb14959d1a9289f94d997e63617dc2.jpg',
                'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_98f9fad958236ef4ca2e16fc3bfe9c44.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_fc75e25b1f3e1cb2bf14d0758b5e10fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_80ac2c282679e177a41a6eae14f0cfb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2942796,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_c28b0b6d7865973a1c03f3eae2bb803d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3025461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_e5b002e3b2d31658aae7e1759e75d1d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_9060b976636b6929f2b5f9dfa8b9bc80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_abd21fb3b76e090ce8b7942af08dec4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2418639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_ad8d45d7f20c1fd812fbedbb2718b19d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_fa7505d82c25e3b466ff017834cf0474.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2636179,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_f4cb14959d1a9289f94d997e63617dc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c/bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6a/766af78fe3c60c6369b2846529e1a4f9/pa/MW60386_98f9fad958236ef4ca2e16fc3bfe9c44.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MINI Roadster Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-28 19:10:40 [auto1.nl] INFO: Saving data for MW60386: {'created_time': 1774725040.064652, 'last_price_update_time': 1774725040.064661, 'auction_closing_time': 1774884051.0}
2026-03-28 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW60386') HTTP/1.1" 204 0
2026-03-28 19:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:41 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Scrape type for SY53039: 0
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Scrape type for SE84312: 2
2026-03-28 19:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-28 19:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189b5ee9-47ba-5495-b9f5-3697f87dccda with scrape type 2
2026-03-28 19:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189b5ee9-47ba-5495-b9f5-3697f87dccda with scrape type 2
2026-03-28 19:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 189b5ee9-47ba-5495-b9f5-3697f87dccda, identifier: SE84312
2026-03-28 19:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-28 19:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-28 19:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312 to the API
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:53:08Z',
 'fuel_type': 'petrol',
 'id': '189b5ee9-47ba-5495-b9f5-3697f87dccda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE84312',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 21936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-12',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Saving data for SE84312: {'auction_closing_time': 1774885988.0, 'created_time': 1774527021.539652, 'last_price_update_time': 1774725041.462114}
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE84312') HTTP/1.1" 204 0
2026-03-28 19:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Scrape type for DZ87358: 0
2026-03-28 19:10:41 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Scrape type for LE78061: 2
2026-03-28 19:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-28 19:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with scrape type 2
2026-03-28 19:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with scrape type 2
2026-03-28 19:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9, identifier: LE78061
2026-03-28 19:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-28 19:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-28 19:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061 to the API
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:20:52Z',
 'fuel_type': 'petrol',
 'id': 'b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE78061',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 58522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-28 19:10:41 [auto1.nl] INFO: Saving data for LE78061: {'auction_closing_time': 1774884052.0, 'created_time': 1774527077.464881, 'last_price_update_time': 1774725041.898747}
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE78061') HTTP/1.1" 204 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for RC74228: 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for MD57319: 2
2026-03-28 19:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-28 19:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32679f86-f323-5b96-9066-2c2a4418452c with scrape type 2
2026-03-28 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32679f86-f323-5b96-9066-2c2a4418452c with scrape type 2
2026-03-28 19:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32679f86-f323-5b96-9066-2c2a4418452c, identifier: MD57319
2026-03-28 19:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-28 19:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-28 19:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319 to the API
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:18:22Z',
 'fuel_type': 'petrol',
 'id': '32679f86-f323-5b96-9066-2c2a4418452c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD57319',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 78243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-24',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2011}
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Saving data for MD57319: {'auction_closing_time': 1774883902.0, 'created_time': 1774527034.780978, 'last_price_update_time': 1774725042.431223}
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD57319') HTTP/1.1" 204 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for NT33284: 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for FR68688: 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for AE06801: 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for WF02577: 2
2026-03-28 19:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-28 19:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162352ca-fec2-50ef-9de6-4dcec3a559e4 with scrape type 2
2026-03-28 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162352ca-fec2-50ef-9de6-4dcec3a559e4 with scrape type 2
2026-03-28 19:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162352ca-fec2-50ef-9de6-4dcec3a559e4, identifier: WF02577
2026-03-28 19:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-28 19:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-28 19:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577 to the API
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:01:03Z',
 'fuel_type': 'petrol',
 'id': '162352ca-fec2-50ef-9de6-4dcec3a559e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF02577',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 175463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Renault Megane 1.6 TCe Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Saving data for WF02577: {'auction_closing_time': 1774882863.0, 'created_time': 1774638628.485381, 'last_price_update_time': 1774725042.900885}
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WF02577') HTTP/1.1" 204 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 19:10:42 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-28 19:10:42 [auto1.nl] INFO: Scrape type for BM26306: 2
2026-03-28 19:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-28 19:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28619a19-5b65-56e6-ac80-f71dc61fb231 with scrape type 2
2026-03-28 19:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28619a19-5b65-56e6-ac80-f71dc61fb231 with scrape type 2
2026-03-28 19:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28619a19-5b65-56e6-ac80-f71dc61fb231, identifier: BM26306
2026-03-28 19:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-28 19:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-28 19:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306 to the API
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:48Z',
 'fuel_type': 'petrol',
 'id': '28619a19-5b65-56e6-ac80-f71dc61fb231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM26306',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 172936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-28 19:10:43 [auto1.nl] INFO: Saving data for BM26306: {'auction_closing_time': 1774884888.0, 'created_time': 1774527026.469105, 'last_price_update_time': 1774725043.320176}
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM26306') HTTP/1.1" 204 0
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE94931%27 HTTP/1.1" 200 None
2026-03-28 19:10:43 [auto1.nl] INFO: Scrape type for NE94931: 1
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-28 19:10:43 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-28 19:10:43 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-28 19:10:43 [auto1.nl] INFO: Scrape type for UB80121: 2
2026-03-28 19:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-28 19:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a4ad5d-7d22-5014-b2dd-f17c86036076 with scrape type 2
2026-03-28 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a4ad5d-7d22-5014-b2dd-f17c86036076 with scrape type 2
2026-03-28 19:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 11a4ad5d-7d22-5014-b2dd-f17c86036076, identifier: UB80121
2026-03-28 19:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-28 19:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-28 19:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121 to the API
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'petrol',
 'id': '11a4ad5d-7d22-5014-b2dd-f17c86036076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB80121',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 63622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-24',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2005}
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-28 19:10:43 [auto1.nl] INFO: Saving data for UB80121: {'auction_closing_time': 1774885961.0, 'created_time': 1774638636.487429, 'last_price_update_time': 1774725043.925079}
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB80121') HTTP/1.1" 204 0
2026-03-28 19:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-28 19:10:43 [auto1.nl] INFO: Scrape type for YE50957: 0
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 19:10:43 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 19:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:44 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for GG02103: 0
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for UC91516: 2
2026-03-28 19:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-28 19:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a48e36-0870-5f29-851c-0c597c61f9d7 with scrape type 2
2026-03-28 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a48e36-0870-5f29-851c-0c597c61f9d7 with scrape type 2
2026-03-28 19:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28a48e36-0870-5f29-851c-0c597c61f9d7, identifier: UC91516
2026-03-28 19:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-28 19:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-28 19:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516 to the API
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-30T15:04:00Z',
 'fuel_type': 'petrol',
 'id': '28a48e36-0870-5f29-851c-0c597c61f9d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC91516',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 241806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Saving data for UC91516: {'auction_closing_time': 1774883040.0, 'created_time': 1773861312.446374, 'last_price_update_time': 1774725044.837146}
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC91516') HTTP/1.1" 204 0
2026-03-28 19:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 19:10:44 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ09106%27 HTTP/1.1" 200 None
2026-03-28 19:10:44 [auto1.nl] INFO: Scrape type for YZ09106: 2
2026-03-28 19:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106
2026-03-28 19:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 252e6800-64b5-5d19-be05-9a2a75035965 with scrape type 2
2026-03-28 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 252e6800-64b5-5d19-be05-9a2a75035965 with scrape type 2
2026-03-28 19:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 252e6800-64b5-5d19-be05-9a2a75035965, identifier: YZ09106
2026-03-28 19:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106
2026-03-28 19:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106
2026-03-28 19:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106 to the API
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:00:09Z',
 'fuel_type': 'petrol',
 'id': '252e6800-64b5-5d19-be05-9a2a75035965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ09106',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'RCZ',
 'odometer': 107837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-04',
 'seller_name': None,
 'title': 'Peugeot RCZ 1.6 THP Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2013}
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ09106%27 HTTP/1.1" 200 None
2026-03-28 19:10:45 [auto1.nl] INFO: Saving data for YZ09106: {'auction_closing_time': 1774882809.0, 'created_time': 1774354487.033438, 'last_price_update_time': 1774725045.393873}
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ09106') HTTP/1.1" 204 0
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-28 19:10:45 [auto1.nl] INFO: Scrape type for GN89359: 0
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-28 19:10:45 [auto1.nl] INFO: Scrape type for NS14796: 2
2026-03-28 19:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-28 19:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74585280-636a-555d-bcd2-59b72e84a7f3 with scrape type 2
2026-03-28 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74585280-636a-555d-bcd2-59b72e84a7f3 with scrape type 2
2026-03-28 19:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74585280-636a-555d-bcd2-59b72e84a7f3, identifier: NS14796
2026-03-28 19:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-28 19:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-28 19:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796 to the API
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:23:10Z',
 'fuel_type': 'petrol',
 'id': '74585280-636a-555d-bcd2-59b72e84a7f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS14796',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 230910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-28 19:10:45 [auto1.nl] INFO: Saving data for NS14796: {'auction_closing_time': 1774884190.0, 'created_time': 1774527048.403402, 'last_price_update_time': 1774725045.826451}
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NS14796') HTTP/1.1" 204 0
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-28 19:10:45 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-28 19:10:45 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-28 19:10:45 [auto1.nl] INFO: Scrape type for VH01672: 2
2026-03-28 19:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-28 19:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with scrape type 2
2026-03-28 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with scrape type 2
2026-03-28 19:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6db109cc-5fc8-5053-8d59-6ac44de9ef03, identifier: VH01672
2026-03-28 19:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE94931/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-28 19:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-28 19:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672 to the API
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:41:43Z',
 'fuel_type': 'hybrid',
 'id': '6db109cc-5fc8-5053-8d59-6ac44de9ef03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH01672',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 226716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2015}
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-28 19:10:46 [auto1.nl] INFO: Saving data for VH01672: {'auction_closing_time': 1774885303.0, 'created_time': 1773837490.962907, 'last_price_update_time': 1774725046.341562}
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH01672') HTTP/1.1" 204 0
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-28 19:10:46 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-28 19:10:46 [auto1.nl] INFO: Scrape type for MW03156: 0
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ58386%27 HTTP/1.1" 200 None
2026-03-28 19:10:46 [auto1.nl] INFO: Scrape type for HJ58386: 1
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-28 19:10:46 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 19:10:46 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 19:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:47 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for YN37403: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for FK39304: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for PY93062: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 19:10:47 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-28 19:10:47 [auto1.nl] INFO: Scrape type for CL54405: 2
2026-03-28 19:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-28 19:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915b7680-b624-52f2-b4e5-980f554a89e1 with scrape type 2
2026-03-28 19:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915b7680-b624-52f2-b4e5-980f554a89e1 with scrape type 2
2026-03-28 19:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 915b7680-b624-52f2-b4e5-980f554a89e1, identifier: CL54405
2026-03-28 19:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-28 19:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-28 19:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405 to the API
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:50:12Z',
 'fuel_type': 'petrol',
 'id': '915b7680-b624-52f2-b4e5-980f554a89e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL54405',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 240816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-09',
 'seller_name': None,
 'title': 'Kia Soul 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Saving data for CL54405: {'auction_closing_time': 1774885812.0, 'created_time': 1774527043.567237, 'last_price_update_time': 1774725048.087404}
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CL54405') HTTP/1.1" 204 0
2026-03-28 19:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Scrape type for MD45251: 0
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Scrape type for EJ39658: 2
2026-03-28 19:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-28 19:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0012bf-5658-5926-af3a-c3b123cb3af9 with scrape type 2
2026-03-28 19:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0012bf-5658-5926-af3a-c3b123cb3af9 with scrape type 2
2026-03-28 19:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ec0012bf-5658-5926-af3a-c3b123cb3af9, identifier: EJ39658
2026-03-28 19:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-28 19:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-28 19:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658 to the API
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:37:30Z',
 'fuel_type': 'petrol',
 'id': 'ec0012bf-5658-5926-af3a-c3b123cb3af9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ39658',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 146441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Saving data for EJ39658: {'auction_closing_time': 1774885050.0, 'created_time': 1774527119.559923, 'last_price_update_time': 1774725048.65875}
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ39658') HTTP/1.1" 204 0
2026-03-28 19:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE94931> (referer: https://www.auto1.com/v1/car-details-view/NE94931/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ58386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 19:10:48 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-28 19:10:48 [auto1.nl] INFO: Scrape type for ME20407: 2
2026-03-28 19:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-28 19:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add5493e-b129-5b80-afd7-0ec6d0d838c9 with scrape type 2
2026-03-28 19:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add5493e-b129-5b80-afd7-0ec6d0d838c9 with scrape type 2
2026-03-28 19:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: add5493e-b129-5b80-afd7-0ec6d0d838c9, identifier: ME20407
2026-03-28 19:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-28 19:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-28 19:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407 to the API
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:27:36Z',
 'fuel_type': 'hybrid',
 'id': 'add5493e-b129-5b80-afd7-0ec6d0d838c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME20407',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 57060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [auto1.nl] INFO: Saving data for ME20407: {'auction_closing_time': 1774884456.0, 'created_time': 1774638641.528342, 'last_price_update_time': 1774725049.104336}
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME20407') HTTP/1.1" 204 0
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [auto1.nl] INFO: Scrape type for LG71332: 2
2026-03-28 19:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-28 19:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with scrape type 2
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with scrape type 2
2026-03-28 19:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d, identifier: LG71332
2026-03-28 19:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-28 19:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-28 19:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332 to the API
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:43:53Z',
 'fuel_type': 'petrol',
 'id': '9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG71332',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 152911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-08',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [auto1.nl] INFO: Saving data for LG71332: {'auction_closing_time': 1774885433.0, 'created_time': 1774638644.173485, 'last_price_update_time': 1774725049.704702}
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG71332') HTTP/1.1" 204 0
2026-03-28 19:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931
2026-03-28 19:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf with scrape type 1
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_e74cd556a1d71f70614a38482b14997e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_e74cd556a1d71f70614a38482b14997e.jpg not downloaded yet
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF49809%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [auto1.nl] INFO: Scrape type for KF49809: 1
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_7b9ad7f3b3f0416784d871067e28c760.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_7b9ad7f3b3f0416784d871067e28c760.jpg not downloaded yet
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [auto1.nl] INFO: Scrape type for AM07460: 0
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [auto1.nl] INFO: Scrape type for FC64695: 0
2026-03-28 19:10:49 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-28 19:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_0658c68ce1bb02b24c74f98c3ba7b61d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_0658c68ce1bb02b24c74f98c3ba7b61d.jpg not downloaded yet
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_04a5dfb2e947470d7866a21f9eef5bd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_04a5dfb2e947470d7866a21f9eef5bd5.jpg not downloaded yet
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_baf58b53077a965801aa9f961d8440df.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_baf58b53077a965801aa9f961d8440df.jpg not downloaded yet
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_b70aaed70ffa2a570c79b7726ac37f00.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_b70aaed70ffa2a570c79b7726ac37f00.jpg not downloaded yet
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_d2df126dc0499a8e76ebf0780e735b8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_d2df126dc0499a8e76ebf0780e735b8d.jpg not downloaded yet
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_582bedddf63a093a7608424785c63952.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_582bedddf63a093a7608424785c63952.jpg not downloaded yet
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_1cad7b38f89b661b37a1ce1787dc818f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_1cad7b38f89b661b37a1ce1787dc818f.jpg not downloaded yet
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_55ed43da4e2bfff29009716aa777114c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_55ed43da4e2bfff29009716aa777114c.jpg not downloaded yet
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_b70aaed70ffa2a570c79b7726ac37f00.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_582bedddf63a093a7608424785c63952.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_1cad7b38f89b661b37a1ce1787dc818f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_0658c68ce1bb02b24c74f98c3ba7b61d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e864a890>
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_b70aaed70ffa2a570c79b7726ac37f00.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_b70aaed70ffa2a570c79b7726ac37f00.jpg saved to cache
2026-03-28 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_e74cd556a1d71f70614a38482b14997e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_d2df126dc0499a8e76ebf0780e735b8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_7b9ad7f3b3f0416784d871067e28c760.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_04a5dfb2e947470d7866a21f9eef5bd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8651610>
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_582bedddf63a093a7608424785c63952.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_582bedddf63a093a7608424785c63952.jpg saved to cache
2026-03-28 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8739a50>
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_1cad7b38f89b661b37a1ce1787dc818f.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_1cad7b38f89b661b37a1ce1787dc818f.jpg saved to cache
2026-03-28 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e864d0d0>
2026-03-28 19:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_0658c68ce1bb02b24c74f98c3ba7b61d.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_0658c68ce1bb02b24c74f98c3ba7b61d.jpg saved to cache
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ58386> (referer: https://www.auto1.com/v1/car-details-view/HJ58386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8688dd0>
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_e74cd556a1d71f70614a38482b14997e.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_e74cd556a1d71f70614a38482b14997e.jpg saved to cache
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83d2090>
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_d2df126dc0499a8e76ebf0780e735b8d.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_d2df126dc0499a8e76ebf0780e735b8d.jpg saved to cache
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e0c50>
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_7b9ad7f3b3f0416784d871067e28c760.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_7b9ad7f3b3f0416784d871067e28c760.jpg saved to cache
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83dab90>
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_04a5dfb2e947470d7866a21f9eef5bd5.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_04a5dfb2e947470d7866a21f9eef5bd5.jpg saved to cache
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:51 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_baf58b53077a965801aa9f961d8440df.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-28 19:10:51 [auto1.nl] INFO: Scrape type for FE91435: 2
2026-03-28 19:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435
2026-03-28 19:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189cafac-7b7a-5c46-850d-5c7206df413d with scrape type 2
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189cafac-7b7a-5c46-850d-5c7206df413d with scrape type 2
2026-03-28 19:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 189cafac-7b7a-5c46-850d-5c7206df413d, identifier: FE91435
2026-03-28 19:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435
2026-03-28 19:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435
2026-03-28 19:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435 to the API
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:18:01Z',
 'fuel_type': 'petrol',
 'id': '189cafac-7b7a-5c46-850d-5c7206df413d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE91435',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 115000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Business Elegance Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Elegance Start/Stop',
 'year': 2021}
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-28 19:10:51 [auto1.nl] INFO: Saving data for FE91435: {'auction_closing_time': 1774883881.0, 'created_time': 1773344054.42304, 'last_price_update_time': 1774725051.627164}
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE91435') HTTP/1.1" 204 0
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-28 19:10:51 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 19:10:51 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-28 19:10:51 [auto1.nl] INFO: Scrape type for WJ55319: 2
2026-03-28 19:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-28 19:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with scrape type 2
2026-03-28 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with scrape type 2
2026-03-28 19:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f, identifier: WJ55319
2026-03-28 19:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-28 19:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-28 19:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319 to the API
2026-03-28 19:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:12:15Z',
 'fuel_type': 'petrol',
 'id': '1e9ea7c4-5e26-5b98-96d5-dfd26e22978f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ55319',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 222302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2013}
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-28 19:10:52 [auto1.nl] INFO: Saving data for WJ55319: {'auction_closing_time': 1774883535.0, 'created_time': 1774527077.070313, 'last_price_update_time': 1774725052.1408}
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WJ55319') HTTP/1.1" 204 0
2026-03-28 19:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386
2026-03-28 19:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee954f56-154d-5a4c-8e68-31e185dc9533 with scrape type 1
2026-03-28 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ee954f56-154d-5a4c-8e68-31e185dc9533
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_33bfdb28a5c676e9b4182d4eeb341c35.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_33bfdb28a5c676e9b4182d4eeb341c35.jpg not downloaded yet
2026-03-28 19:10:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e4b90>
2026-03-28 19:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_baf58b53077a965801aa9f961d8440df.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_baf58b53077a965801aa9f961d8440df.jpg saved to cache
2026-03-28 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-28 19:10:52 [auto1.nl] INFO: Scrape type for HK90585: 0
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 19:10:52 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-28 19:10:52 [auto1.nl] INFO: Scrape type for FB20368: 2
2026-03-28 19:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368
2026-03-28 19:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with scrape type 2
2026-03-28 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with scrape type 2
2026-03-28 19:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1, identifier: FB20368
2026-03-28 19:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368
2026-03-28 19:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368
2026-03-28 19:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368 to the API
2026-03-28 19:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:33Z',
 'fuel_type': 'diesel',
 'id': 'ad59ec4a-db09-5632-a5c5-d29ccd21a6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB20368',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 277082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-28 19:10:53 [auto1.nl] INFO: Saving data for FB20368: {'auction_closing_time': 1774884573.0, 'created_time': 1773861219.747487, 'last_price_update_time': 1774725053.134651}
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB20368') HTTP/1.1" 204 0
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_3304e2784be6c9515cc7df9a354a8c1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_3304e2784be6c9515cc7df9a354a8c1b.jpg not downloaded yet
2026-03-28 19:10:53 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 19:10:53 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-28 19:10:53 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-28 19:10:53 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 19:10:53 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-28 19:10:53 [auto1.nl] INFO: Scrape type for VB13156: 2
2026-03-28 19:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-28 19:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with scrape type 2
2026-03-28 19:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with scrape type 2
2026-03-28 19:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c, identifier: VB13156
2026-03-28 19:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF49809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-28 19:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-28 19:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156 to the API
2026-03-28 19:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:03Z',
 'fuel_type': 'petrol',
 'id': 'ea329a1a-3c4c-5d10-8e9e-ab41d502d10c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB13156',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 157239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Saving data for VB13156: {'auction_closing_time': 1774885863.0, 'created_time': 1774527084.011915, 'last_price_update_time': 1774725054.140974}
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VB13156') HTTP/1.1" 204 0
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_fcbf6f9ab15115a4b00ad81007bcc76b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_fcbf6f9ab15115a4b00ad81007bcc76b.jpg not downloaded yet
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for PN82428: 0
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for YR49127: 0
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for WC97739: 2
2026-03-28 19:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-28 19:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f26a86-04a1-54ac-847d-87305f01649e with scrape type 2
2026-03-28 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f26a86-04a1-54ac-847d-87305f01649e with scrape type 2
2026-03-28 19:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96f26a86-04a1-54ac-847d-87305f01649e, identifier: WC97739
2026-03-28 19:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-28 19:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-28 19:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739 to the API
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:31:15Z',
 'fuel_type': 'petrol',
 'id': '96f26a86-04a1-54ac-847d-87305f01649e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC97739',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 123196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Saving data for WC97739: {'auction_closing_time': 1774884675.0, 'created_time': 1774527070.82757, 'last_price_update_time': 1774725054.661066}
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC97739') HTTP/1.1" 204 0
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_484e7b32154b924313962c1769684e2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_484e7b32154b924313962c1769684e2a.jpg not downloaded yet
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for BP06390: 0
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for VB96147: 0
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 19:10:54 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-28 19:10:54 [auto1.nl] INFO: Scrape type for DW43709: 2
2026-03-28 19:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-28 19:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 366e2ea1-0eee-5832-a306-aeed007a1b55 with scrape type 2
2026-03-28 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 366e2ea1-0eee-5832-a306-aeed007a1b55 with scrape type 2
2026-03-28 19:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 366e2ea1-0eee-5832-a306-aeed007a1b55, identifier: DW43709
2026-03-28 19:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_33bfdb28a5c676e9b4182d4eeb341c35.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-28 19:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-28 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709 to the API
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:09Z',
 'fuel_type': 'petrol',
 'id': '366e2ea1-0eee-5832-a306-aeed007a1b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW43709',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 80671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2017}
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Saving data for DW43709: {'auction_closing_time': 1774883709.0, 'created_time': 1774527075.124354, 'last_price_update_time': 1774725055.308163}
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW43709') HTTP/1.1" 204 0
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_ef65135189f4928ec1da68cbe3d2cee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_ef65135189f4928ec1da68cbe3d2cee2.jpg not downloaded yet
2026-03-28 19:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_3304e2784be6c9515cc7df9a354a8c1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_398aedf9307776229c4281467ba21eff.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_398aedf9307776229c4281467ba21eff.jpg not downloaded yet
2026-03-28 19:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8747590>
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_33bfdb28a5c676e9b4182d4eeb341c35.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_33bfdb28a5c676e9b4182d4eeb341c35.jpg saved to cache
2026-03-28 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee954f56-154d-5a4c-8e68-31e185dc9533
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83be0d0>
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_3304e2784be6c9515cc7df9a354a8c1b.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_3304e2784be6c9515cc7df9a354a8c1b.jpg saved to cache
2026-03-28 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee954f56-154d-5a4c-8e68-31e185dc9533
2026-03-28 19:10:55 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 646 | hits on page: 40
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for SM08260: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for AB34968: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for SZ87293: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for SY05694: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for YB51800: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-28 19:10:55 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-28 19:10:55 [auto1.nl] INFO: Scrape type for SG32295: 2
2026-03-28 19:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-28 19:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a15bdf39-e115-550b-ae6a-5b61e2f7917b with scrape type 2
2026-03-28 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a15bdf39-e115-550b-ae6a-5b61e2f7917b with scrape type 2
2026-03-28 19:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a15bdf39-e115-550b-ae6a-5b61e2f7917b, identifier: SG32295
2026-03-28 19:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_55ed43da4e2bfff29009716aa777114c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-28 19:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-28 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295 to the API
2026-03-28 19:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:42:35Z',
 'fuel_type': 'diesel',
 'id': 'a15bdf39-e115-550b-ae6a-5b61e2f7917b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG32295',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 256398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Saving data for SG32295: {'auction_closing_time': 1774885355.0, 'created_time': 1774527073.68788, 'last_price_update_time': 1774725056.126542}
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG32295') HTTP/1.1" 204 0
2026-03-28 19:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_484e7b32154b924313962c1769684e2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_ef65135189f4928ec1da68cbe3d2cee2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for EU67961: 0
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for TU99712: 2
2026-03-28 19:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-28 19:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96456424-0567-5400-a6a2-f9b54836aa7f with scrape type 2
2026-03-28 19:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96456424-0567-5400-a6a2-f9b54836aa7f with scrape type 2
2026-03-28 19:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96456424-0567-5400-a6a2-f9b54836aa7f, identifier: TU99712
2026-03-28 19:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_fcbf6f9ab15115a4b00ad81007bcc76b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_398aedf9307776229c4281467ba21eff.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-28 19:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-28 19:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712 to the API
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:24:43Z',
 'fuel_type': 'petrol',
 'id': '96456424-0567-5400-a6a2-f9b54836aa7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU99712',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 65577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'BMW 3er 330i GT xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2017}
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Saving data for TU99712: {'auction_closing_time': 1774884283.0, 'created_time': 1774638635.201322, 'last_price_update_time': 1774725056.757671}
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU99712') HTTP/1.1" 204 0
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 19:10:56 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-28 19:10:56 [auto1.nl] INFO: Scrape type for BX66014: 2
2026-03-28 19:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-28 19:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c90c6f-46d6-5f66-901c-63a9880b940f with scrape type 2
2026-03-28 19:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02c90c6f-46d6-5f66-901c-63a9880b940f with scrape type 2
2026-03-28 19:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02c90c6f-46d6-5f66-901c-63a9880b940f, identifier: BX66014
2026-03-28 19:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-28 19:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-28 19:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014 to the API
2026-03-28 19:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'hybrid',
 'id': '02c90c6f-46d6-5f66-901c-63a9880b940f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX66014',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 217631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-22',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four',
 'transmission': 'automatic',
 'trim': 'E-Four',
 'year': 2014}
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-28 19:10:58 [auto1.nl] INFO: Saving data for BX66014: {'auction_closing_time': 1774884401.0, 'created_time': 1774638646.589572, 'last_price_update_time': 1774725058.113841}
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BX66014') HTTP/1.1" 204 0
2026-03-28 19:10:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84d7050>
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fc7%252F78c7ffffd83f798bd71316ca461d60e7%252Fpa%252FNE94931_55ed43da4e2bfff29009716aa777114c.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_55ed43da4e2bfff29009716aa777114c.jpg saved to cache
2026-03-28 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf
2026-03-28 19:10:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d635a65-af3c-56a4-a99f-745dbf8e0edf, skipping ID generation
2026-03-28 19:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf with scrape type 1
2026-03-28 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf sending to next pipeline
2026-03-28 19:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d635a65-af3c-56a4-a99f-745dbf8e0edf, identifier: NE94931
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8559c10>
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_484e7b32154b924313962c1769684e2a.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_484e7b32154b924313962c1769684e2a.jpg saved to cache
2026-03-28 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee954f56-154d-5a4c-8e68-31e185dc9533
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8664750>
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_ef65135189f4928ec1da68cbe3d2cee2.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_ef65135189f4928ec1da68cbe3d2cee2.jpg saved to cache
2026-03-28 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee954f56-154d-5a4c-8e68-31e185dc9533
2026-03-28 19:10:58 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 19:10:58 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 19:10:58 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 19:10:58 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 19:10:58 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-28 19:10:58 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-28 19:10:58 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-28 19:10:58 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC54517%27 HTTP/1.1" 200 None
2026-03-28 19:10:58 [auto1.nl] INFO: Scrape type for VC54517: 1
2026-03-28 19:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931
2026-03-28 19:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931
2026-03-28 19:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931 to the API
2026-03-28 19:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_55ed43da4e2bfff29009716aa777114c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 82,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:11:06Z',
 'fuel_type': 'diesel',
 'id': '3d635a65-af3c-56a4-a99f-745dbf8e0edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GR573N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE94931',
 'listing': 'auction',
 'location': 'NL, Koog aan de Zaan',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 286793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_e74cd556a1d71f70614a38482b14997e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_7b9ad7f3b3f0416784d871067e28c760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_0658c68ce1bb02b24c74f98c3ba7b61d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_04a5dfb2e947470d7866a21f9eef5bd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830322,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_baf58b53077a965801aa9f961d8440df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_b70aaed70ffa2a570c79b7726ac37f00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_d2df126dc0499a8e76ebf0780e735b8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817048,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_582bedddf63a093a7608424785c63952.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_1cad7b38f89b661b37a1ce1787dc818f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d635a65-af3c-56a4-a99f-745dbf8e0edf/3d635a65-af3c-56a4-a99f-745dbf8e0edf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/c7/78c7ffffd83f798bd71316ca461d60e7/pa/NE94931_55ed43da4e2bfff29009716aa777114c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2015}
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE94931%27 HTTP/1.1" 200 None
2026-03-28 19:10:59 [auto1.nl] INFO: Saving data for NE94931: {'created_time': 1774725059.157855, 'last_price_update_time': 1774725059.157865, 'auction_closing_time': 1774883466.0}
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NE94931') HTTP/1.1" 204 0
2026-03-28 19:10:59 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-28 19:10:59 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-28 19:10:59 [auto1.nl] INFO: Scrape type for BY11680: 2
2026-03-28 19:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680
2026-03-28 19:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00fe4caf-1d24-5435-86fa-71a7c9a38274 with scrape type 2
2026-03-28 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00fe4caf-1d24-5435-86fa-71a7c9a38274 with scrape type 2
2026-03-28 19:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00fe4caf-1d24-5435-86fa-71a7c9a38274, identifier: BY11680
2026-03-28 19:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF49809> (referer: https://www.auto1.com/v1/car-details-view/KF49809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84b6650>
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_fcbf6f9ab15115a4b00ad81007bcc76b.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_fcbf6f9ab15115a4b00ad81007bcc76b.jpg saved to cache
2026-03-28 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee954f56-154d-5a4c-8e68-31e185dc9533
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84ca0d0>
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff1%252F7ef182aa6be6a52ad7b99d9dd31c4fea%252Fpa%252FHJ58386_398aedf9307776229c4281467ba21eff.jpg') HTTP/1.1" 204 0
2026-03-28 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_398aedf9307776229c4281467ba21eff.jpg saved to cache
2026-03-28 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee954f56-154d-5a4c-8e68-31e185dc9533
2026-03-28 19:10:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee954f56-154d-5a4c-8e68-31e185dc9533, skipping ID generation
2026-03-28 19:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee954f56-154d-5a4c-8e68-31e185dc9533 with scrape type 1
2026-03-28 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee954f56-154d-5a4c-8e68-31e185dc9533 sending to next pipeline
2026-03-28 19:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ee954f56-154d-5a4c-8e68-31e185dc9533, identifier: HJ58386
2026-03-28 19:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680
2026-03-28 19:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680
2026-03-28 19:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680 to the API
2026-03-28 19:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:14:36Z',
 'fuel_type': 'petrol',
 'id': '00fe4caf-1d24-5435-86fa-71a7c9a38274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY11680',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 222796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [auto1.nl] INFO: Saving data for BY11680: {'auction_closing_time': 1774883676.0, 'created_time': 1773404908.848989, 'last_price_update_time': 1774725060.16304}
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY11680') HTTP/1.1" 204 0
2026-03-28 19:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386
2026-03-28 19:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386
2026-03-28 19:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386 to the API
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_398aedf9307776229c4281467ba21eff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:20Z',
 'fuel_type': 'petrol',
 'id': 'ee954f56-154d-5a4c-8e68-31e185dc9533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '01nvn1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ58386',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 293692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_33bfdb28a5c676e9b4182d4eeb341c35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_3304e2784be6c9515cc7df9a354a8c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_fcbf6f9ab15115a4b00ad81007bcc76b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_484e7b32154b924313962c1769684e2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_ef65135189f4928ec1da68cbe3d2cee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee954f56-154d-5a4c-8e68-31e185dc9533/ee954f56-154d-5a4c-8e68-31e185dc9533_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/f1/7ef182aa6be6a52ad7b99d9dd31c4fea/pa/HJ58386_398aedf9307776229c4281467ba21eff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ58386%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [auto1.nl] INFO: Saving data for HJ58386: {'created_time': 1774725060.520572, 'last_price_update_time': 1774725060.520582, 'auction_closing_time': 1774885100.0}
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ58386') HTTP/1.1" 204 0
2026-03-28 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809
2026-03-28 19:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c0a7dc-681d-584d-9516-17310bee504a with scrape type 1
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_5840f88c5e4cc0e61a7e2af0d7b693eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_5840f88c5e4cc0e61a7e2af0d7b693eb.jpg not downloaded yet
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_101c5dc30b425089ba5d5ab96d201a83.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_101c5dc30b425089ba5d5ab96d201a83.jpg not downloaded yet
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_d7d7e5b02ec63b8b548ad51b7ffed82e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d7d7e5b02ec63b8b548ad51b7ffed82e.jpg not downloaded yet
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_e7735bb219f2f9f02405ad96ba622176.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_e7735bb219f2f9f02405ad96ba622176.jpg not downloaded yet
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_86d3980127d653e945834fab8551e8f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_86d3980127d653e945834fab8551e8f7.jpg not downloaded yet
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_d8081fb006c68ee4f8eb36b8be75d0c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d8081fb006c68ee4f8eb36b8be75d0c8.jpg not downloaded yet
2026-03-28 19:11:00 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 646 | hits on page: 40
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_1433146c43b7ec9bf224750680ff6d62.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_1433146c43b7ec9bf224750680ff6d62.jpg not downloaded yet
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC21131%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [auto1.nl] INFO: Scrape type for VC21131: 1
2026-03-28 19:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_fc887c96493622d285e8995fafc835db.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_fc887c96493622d285e8995fafc835db.jpg not downloaded yet
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: ZP46172
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81542%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [auto1.nl] INFO: Scrape type for UR81542: 1
2026-03-28 19:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_248662874edb4b8e28d28bceaa314c29.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_248662874edb4b8e28d28bceaa314c29.jpg not downloaded yet
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR03129%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [auto1.nl] INFO: Scrape type for BR03129: 1
2026-03-28 19:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_a443b82e5c0764d9efd4caa4cdc6f325.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_a443b82e5c0764d9efd4caa4cdc6f325.jpg not downloaded yet
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [auto1.nl] INFO: Scrape type for XP28763: 1
2026-03-28 19:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d7d7e5b02ec63b8b548ad51b7ffed82e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-28 19:11:00 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL62659%27 HTTP/1.1" 200 None
2026-03-28 19:11:00 [auto1.nl] INFO: Scrape type for HL62659: 2
2026-03-28 19:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659
2026-03-28 19:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88813e8-b510-5040-91b7-85945afd3d33 with scrape type 2
2026-03-28 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88813e8-b510-5040-91b7-85945afd3d33 with scrape type 2
2026-03-28 19:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f88813e8-b510-5040-91b7-85945afd3d33, identifier: HL62659
2026-03-28 19:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659
2026-03-28 19:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659
2026-03-28 19:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659 to the API
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:08:02Z',
 'fuel_type': 'petrol',
 'id': 'f88813e8-b510-5040-91b7-85945afd3d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL62659',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 65995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL62659%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Saving data for HL62659: {'auction_closing_time': 1774883282.0, 'created_time': 1774268045.51475, 'last_price_update_time': 1774725061.29932}
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL62659') HTTP/1.1" 204 0
2026-03-28 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_fc887c96493622d285e8995fafc835db.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF69205%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for MF69205: 1
2026-03-28 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_248662874edb4b8e28d28bceaa314c29.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_86d3980127d653e945834fab8551e8f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d8081fb006c68ee4f8eb36b8be75d0c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_1433146c43b7ec9bf224750680ff6d62.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH69810%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for DH69810: 1
2026-03-28 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC54517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8766810>
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_d7d7e5b02ec63b8b548ad51b7ffed82e.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d7d7e5b02ec63b8b548ad51b7ffed82e.jpg saved to cache
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB68589%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for DB68589: 1
2026-03-28 19:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_a443b82e5c0764d9efd4caa4cdc6f325.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for WG42782: 1
2026-03-28 19:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e3050>
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_fc887c96493622d285e8995fafc835db.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_fc887c96493622d285e8995fafc835db.jpg saved to cache
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF41961%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for RF41961: 1
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8667310>
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_248662874edb4b8e28d28bceaa314c29.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_248662874edb4b8e28d28bceaa314c29.jpg saved to cache
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e871ff10>
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_86d3980127d653e945834fab8551e8f7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_86d3980127d653e945834fab8551e8f7.jpg saved to cache
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84b5250>
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_d8081fb006c68ee4f8eb36b8be75d0c8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d8081fb006c68ee4f8eb36b8be75d0c8.jpg saved to cache
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8744710>
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_1433146c43b7ec9bf224750680ff6d62.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_1433146c43b7ec9bf224750680ff6d62.jpg saved to cache
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC40672%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for BC40672: 1
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84cf750>
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_a443b82e5c0764d9efd4caa4cdc6f325.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_a443b82e5c0764d9efd4caa4cdc6f325.jpg saved to cache
2026-03-28 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR08670%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for PR08670: 1
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: RZ76461
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RZ76461%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for RZ76461: 1
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR36555%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for DR36555: 1
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ98625%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for BZ98625: 1
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for GM68754: 1
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP71821%27 HTTP/1.1" 200 None
2026-03-28 19:11:01 [auto1.nl] INFO: Scrape type for JP71821: 1
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-28 19:11:01 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-28 19:11:02 [auto1.nl] INFO: Scrape type for BG04233: 1
2026-03-28 19:11:02 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-28 19:11:02 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-28 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-28 19:11:02 [auto1.nl] INFO: Scrape type for AT06250: 2
2026-03-28 19:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-28 19:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657fc4a3-6836-5e36-9e93-986b184640ec with scrape type 2
2026-03-28 19:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 657fc4a3-6836-5e36-9e93-986b184640ec with scrape type 2
2026-03-28 19:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 657fc4a3-6836-5e36-9e93-986b184640ec, identifier: AT06250
2026-03-28 19:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-28 19:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-28 19:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250 to the API
2026-03-28 19:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'petrol',
 'id': '657fc4a3-6836-5e36-9e93-986b184640ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT06250',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 83795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-28 19:11:03 [auto1.nl] INFO: Saving data for AT06250: {'auction_closing_time': 1774884037.0, 'created_time': 1773232172.092675, 'last_price_update_time': 1774725063.153108}
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AT06250') HTTP/1.1" 204 0
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_5840f88c5e4cc0e61a7e2af0d7b693eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:03 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-28 19:11:03 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-28 19:11:03 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-28 19:11:03 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_101c5dc30b425089ba5d5ab96d201a83.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF69205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC21131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR81542/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP28763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR03129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_e7735bb219f2f9f02405ad96ba622176.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e843d290>
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_5840f88c5e4cc0e61a7e2af0d7b693eb.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_5840f88c5e4cc0e61a7e2af0d7b693eb.jpg saved to cache
2026-03-28 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85366d0>
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_101c5dc30b425089ba5d5ab96d201a83.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_101c5dc30b425089ba5d5ab96d201a83.jpg saved to cache
2026-03-28 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:03 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 646 | hits on page: 40
2026-03-28 19:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82fcad0>
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e68e85b159bbfa25b304fdfca508f0%252Fpa%252FKF49809_e7735bb219f2f9f02405ad96ba622176.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_e7735bb219f2f9f02405ad96ba622176.jpg saved to cache
2026-03-28 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94c0a7dc-681d-584d-9516-17310bee504a
2026-03-28 19:11:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94c0a7dc-681d-584d-9516-17310bee504a, skipping ID generation
2026-03-28 19:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c0a7dc-681d-584d-9516-17310bee504a with scrape type 1
2026-03-28 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94c0a7dc-681d-584d-9516-17310bee504a sending to next pipeline
2026-03-28 19:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 94c0a7dc-681d-584d-9516-17310bee504a, identifier: KF49809
2026-03-28 19:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809
2026-03-28 19:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809
2026-03-28 19:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809 to the API
2026-03-28 19:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_e7735bb219f2f9f02405ad96ba622176.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'diesel',
 'id': '94c0a7dc-681d-584d-9516-17310bee504a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '5XVB69',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF49809',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 268876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_5840f88c5e4cc0e61a7e2af0d7b693eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643601,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_101c5dc30b425089ba5d5ab96d201a83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d7d7e5b02ec63b8b548ad51b7ffed82e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868799,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_e7735bb219f2f9f02405ad96ba622176.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_86d3980127d653e945834fab8551e8f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_d8081fb006c68ee4f8eb36b8be75d0c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_1433146c43b7ec9bf224750680ff6d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_fc887c96493622d285e8995fafc835db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_248662874edb4b8e28d28bceaa314c29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94c0a7dc-681d-584d-9516-17310bee504a/94c0a7dc-681d-584d-9516-17310bee504a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e68e85b159bbfa25b304fdfca508f0/pa/KF49809_a443b82e5c0764d9efd4caa4cdc6f325.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2014}
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF49809%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Saving data for KF49809: {'created_time': 1774725064.26509, 'last_price_update_time': 1774725064.265101, 'auction_closing_time': 1774884566.0}
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KF49809') HTTP/1.1" 204 0
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW17706%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for JW17706: 1
2026-03-28 19:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH69810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU81834%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for GU81834: 1
2026-03-28 19:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB68589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC15859%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for BC15859: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR27425%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for XR27425: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for ME79677: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT04530%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for PT04530: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS03610%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for PS03610: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18286%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for MD18286: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for EB08844: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for PV55742: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for AM51490: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD35327%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for MD35327: 1
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-28 19:11:04 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Scrape type for TR09691: 2
2026-03-28 19:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691
2026-03-28 19:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba382fd-1d5f-5600-8a91-36831d820517 with scrape type 2
2026-03-28 19:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dba382fd-1d5f-5600-8a91-36831d820517 with scrape type 2
2026-03-28 19:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dba382fd-1d5f-5600-8a91-36831d820517, identifier: TR09691
2026-03-28 19:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691
2026-03-28 19:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691
2026-03-28 19:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691 to the API
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:52Z',
 'fuel_type': 'petrol',
 'id': 'dba382fd-1d5f-5600-8a91-36831d820517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR09691',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 78186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-05',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Attractive',
 'transmission': 'manual',
 'trim': 'Attractive',
 'year': 2011}
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-28 19:11:04 [auto1.nl] INFO: Saving data for TR09691: {'auction_closing_time': 1774884172.0, 'created_time': 1773429235.774523, 'last_price_update_time': 1774725064.970966}
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TR09691') HTTP/1.1" 204 0
2026-03-28 19:11:05 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-28 19:11:05 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-28 19:11:05 [auto1.nl] INFO: Scrape type for KX19183: 1
2026-03-28 19:11:05 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-28 19:11:05 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-28 19:11:05 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-28 19:11:05 [auto1.nl] INFO: Scrape type for JH24547: 2
2026-03-28 19:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-28 19:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64fcd272-55ff-5554-82d7-a83a99840a93 with scrape type 2
2026-03-28 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64fcd272-55ff-5554-82d7-a83a99840a93 with scrape type 2
2026-03-28 19:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64fcd272-55ff-5554-82d7-a83a99840a93, identifier: JH24547
2026-03-28 19:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC40672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF41961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR08670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-28 19:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547 to the API
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:59:26Z',
 'fuel_type': 'petrol',
 'id': '64fcd272-55ff-5554-82d7-a83a99840a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH24547',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 134675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2011}
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-28 19:11:05 [auto1.nl] INFO: Saving data for JH24547: {'auction_closing_time': 1774886366.0, 'created_time': 1774002007.214212, 'last_price_update_time': 1774725065.609429}
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH24547') HTTP/1.1" 204 0
2026-03-28 19:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG42782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:05 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-28 19:11:05 [auto1.nl] INFO: Scrape type for HL97424: 2
2026-03-28 19:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424
2026-03-28 19:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b142a74b-0dc8-5858-9e36-b6a7a45c034f with scrape type 2
2026-03-28 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b142a74b-0dc8-5858-9e36-b6a7a45c034f with scrape type 2
2026-03-28 19:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b142a74b-0dc8-5858-9e36-b6a7a45c034f, identifier: HL97424
2026-03-28 19:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 19:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424
2026-03-28 19:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424 to the API
2026-03-28 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:51Z',
 'fuel_type': 'petrol',
 'id': 'b142a74b-0dc8-5858-9e36-b6a7a45c034f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL97424',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 123030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Saving data for HL97424: {'auction_closing_time': 1774885311.0, 'created_time': 1774552341.297915, 'last_price_update_time': 1774725066.198789}
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL97424') HTTP/1.1" 204 0
2026-03-28 19:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC54517> (referer: https://www.auto1.com/v1/car-details-view/VC54517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for AB85439: 2
2026-03-28 19:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439
2026-03-28 19:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64834400-65f6-529c-b167-b62b8d0bfa52 with scrape type 2
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64834400-65f6-529c-b167-b62b8d0bfa52 with scrape type 2
2026-03-28 19:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64834400-65f6-529c-b167-b62b8d0bfa52, identifier: AB85439
2026-03-28 19:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439
2026-03-28 19:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439
2026-03-28 19:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439 to the API
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:09Z',
 'fuel_type': 'petrol',
 'id': '64834400-65f6-529c-b167-b62b8d0bfa52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB85439',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 82569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-19',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Saving data for AB85439: {'auction_closing_time': 1774882809.0, 'created_time': 1774552339.04329, 'last_price_update_time': 1774725066.677146}
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB85439') HTTP/1.1" 204 0
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for UE65811: 0
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for UY86442: 0
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for WG90560: 0
2026-03-28 19:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR03129> (referer: https://www.auto1.com/v1/car-details-view/BR03129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:06 [scrapy.extensions.logstats] INFO: Crawled 52 pages (at 52 pages/min), scraped 61 items (at 61 items/min)
2026-03-28 19:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-28 19:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517
2026-03-28 19:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 305c184d-8d9a-528a-86e9-11d64f03f657 with scrape type 1
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 305c184d-8d9a-528a-86e9-11d64f03f657
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_449e8fb4de73f55342b0c02dc426b0b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_449e8fb4de73f55342b0c02dc426b0b7.jpg not downloaded yet
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_c1c568d5ea9e8c86ae37f48941c27c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_c1c568d5ea9e8c86ae37f48941c27c73.jpg not downloaded yet
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_2411203ef46ca776d554d999b52c0d35.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_2411203ef46ca776d554d999b52c0d35.jpg not downloaded yet
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_68a9b1a82bf8a7284c1cbc592b360b6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_68a9b1a82bf8a7284c1cbc592b360b6d.jpg not downloaded yet
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_7353cdd9fbcf962b05e5c0a6feee7257.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_7353cdd9fbcf962b05e5c0a6feee7257.jpg not downloaded yet
2026-03-28 19:11:06 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 646 | hits on page: 40
2026-03-28 19:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129
2026-03-28 19:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b00510c-442a-536c-8714-52b6a8ab0e77 with scrape type 1
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 5b00510c-442a-536c-8714-52b6a8ab0e77
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_62b9e943c7113c92d1bf4437e53086fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_62b9e943c7113c92d1bf4437e53086fb.jpg not downloaded yet
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for UR39080: 0
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for PH88105: 0
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for UF12505: 0
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-28 19:11:06 [auto1.nl] INFO: Scrape type for XK28167: 0
2026-03-28 19:11:06 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-28 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for JC30911: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for AX92237: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for UB73502: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for TP02076: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for BV07887: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for ZE09391: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for ER86910: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for DR23359: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for MH16372: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for ME24209: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for PU27111: 2
2026-03-28 19:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-28 19:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24002d7d-366e-54b7-bc2d-8df145edd940 with scrape type 2
2026-03-28 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24002d7d-366e-54b7-bc2d-8df145edd940 with scrape type 2
2026-03-28 19:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 24002d7d-366e-54b7-bc2d-8df145edd940, identifier: PU27111
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_ba891feb06a2447246f477cf70535708.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_ba891feb06a2447246f477cf70535708.jpg not downloaded yet
2026-03-28 19:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-28 19:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-28 19:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111 to the API
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'petrol',
 'id': '24002d7d-366e-54b7-bc2d-8df145edd940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU27111',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 190272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Saving data for PU27111: {'auction_closing_time': 1774883102.0, 'created_time': 1774354594.942365, 'last_price_update_time': 1774725067.619028}
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PU27111') HTTP/1.1" 204 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for EH33258: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for SE67800: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for TN45594: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for HK48702: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [auto1.nl] INFO: Scrape type for PX89333: 0
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-28 19:11:07 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_8e44bbe26d145a646fcdd3c0776efc79.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_8e44bbe26d145a646fcdd3c0776efc79.jpg not downloaded yet
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_fca2a45584c8030c01fa6f0a0650066d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_fca2a45584c8030c01fa6f0a0650066d.jpg not downloaded yet
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG04233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW17706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_fca2a45584c8030c01fa6f0a0650066d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_8e44bbe26d145a646fcdd3c0776efc79.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR81542> (referer: https://www.auto1.com/v1/car-details-view/UR81542/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC21131> (referer: https://www.auto1.com/v1/car-details-view/VC21131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_ba891feb06a2447246f477cf70535708.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_62b9e943c7113c92d1bf4437e53086fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP71821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83bdd50>
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_fca2a45584c8030c01fa6f0a0650066d.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_fca2a45584c8030c01fa6f0a0650066d.jpg saved to cache
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b00510c-442a-536c-8714-52b6a8ab0e77
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8771f90>
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_8e44bbe26d145a646fcdd3c0776efc79.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_8e44bbe26d145a646fcdd3c0776efc79.jpg saved to cache
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b00510c-442a-536c-8714-52b6a8ab0e77
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_68a9b1a82bf8a7284c1cbc592b360b6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_7353cdd9fbcf962b05e5c0a6feee7257.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542
2026-03-28 19:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3401a8b0-13c2-5a20-985d-597667095bfe with scrape type 1
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 3401a8b0-13c2-5a20-985d-597667095bfe
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_b0a0a58d01a1e8bc6c2ec6d37ae30cb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_b0a0a58d01a1e8bc6c2ec6d37ae30cb6.jpg not downloaded yet
2026-03-28 19:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131
2026-03-28 19:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with scrape type 1
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_01b6155247eb375133041bc4ee861cf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_01b6155247eb375133041bc4ee861cf6.jpg not downloaded yet
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84b7e10>
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_ba891feb06a2447246f477cf70535708.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_ba891feb06a2447246f477cf70535708.jpg saved to cache
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b00510c-442a-536c-8714-52b6a8ab0e77
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e863ee50>
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fbb%252F39bb7131fa8429bc49d7a5bd8de8d551%252Fpa%252FBR03129_62b9e943c7113c92d1bf4437e53086fb.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_62b9e943c7113c92d1bf4437e53086fb.jpg saved to cache
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b00510c-442a-536c-8714-52b6a8ab0e77
2026-03-28 19:11:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b00510c-442a-536c-8714-52b6a8ab0e77, skipping ID generation
2026-03-28 19:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b00510c-442a-536c-8714-52b6a8ab0e77 with scrape type 1
2026-03-28 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b00510c-442a-536c-8714-52b6a8ab0e77 sending to next pipeline
2026-03-28 19:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b00510c-442a-536c-8714-52b6a8ab0e77, identifier: BR03129
2026-03-28 19:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129
2026-03-28 19:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129
2026-03-28 19:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129 to the API
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_62b9e943c7113c92d1bf4437e53086fb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'petrol',
 'id': '5b00510c-442a-536c-8714-52b6a8ab0e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PD340L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR03129',
 'listing': 'auction',
 'location': 'NL, Ede',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 112978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_62b9e943c7113c92d1bf4437e53086fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_ba891feb06a2447246f477cf70535708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_8e44bbe26d145a646fcdd3c0776efc79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b00510c-442a-536c-8714-52b6a8ab0e77/5b00510c-442a-536c-8714-52b6a8ab0e77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/bb/39bb7131fa8429bc49d7a5bd8de8d551/pa/BR03129_fca2a45584c8030c01fa6f0a0650066d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-02-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Opel Tigra 1.8 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2007}
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR03129%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [auto1.nl] INFO: Saving data for BR03129: {'created_time': 1774725069.318233, 'last_price_update_time': 1774725069.318246, 'auction_closing_time': 1774884663.0}
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BR03129') HTTP/1.1" 204 0
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_cba5f5249bc50be1b9937bf02592cb74.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_cba5f5249bc50be1b9937bf02592cb74.jpg not downloaded yet
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_cc90db3c316ab02e426c17245c828748.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_cc90db3c316ab02e426c17245c828748.jpg not downloaded yet
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_2411203ef46ca776d554d999b52c0d35.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_c1c568d5ea9e8c86ae37f48941c27c73.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_6c527ae01fc2ceeef8f434d546deec9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_6c527ae01fc2ceeef8f434d546deec9a.jpg not downloaded yet
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_61752d4651517d3f7421778738123700.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_61752d4651517d3f7421778738123700.jpg not downloaded yet
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX19183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF69205> (referer: https://www.auto1.com/v1/car-details-view/MF69205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM68754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83c1250>
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_68a9b1a82bf8a7284c1cbc592b360b6d.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_68a9b1a82bf8a7284c1cbc592b360b6d.jpg saved to cache
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 305c184d-8d9a-528a-86e9-11d64f03f657
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8689810>
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_7353cdd9fbcf962b05e5c0a6feee7257.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_7353cdd9fbcf962b05e5c0a6feee7257.jpg saved to cache
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 305c184d-8d9a-528a-86e9-11d64f03f657
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_ed807d6796117098db640e7b64792190.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_ed807d6796117098db640e7b64792190.jpg not downloaded yet
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_e3e3b00503e00889579b52f1119fb696.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_e3e3b00503e00889579b52f1119fb696.jpg not downloaded yet
2026-03-28 19:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ98625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_62c1fdab821a95e72b1880286bb1a77e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_62c1fdab821a95e72b1880286bb1a77e.jpg not downloaded yet
2026-03-28 19:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85fc190>
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_2411203ef46ca776d554d999b52c0d35.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_2411203ef46ca776d554d999b52c0d35.jpg saved to cache
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 305c184d-8d9a-528a-86e9-11d64f03f657
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85dff10>
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_c1c568d5ea9e8c86ae37f48941c27c73.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_c1c568d5ea9e8c86ae37f48941c27c73.jpg saved to cache
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 305c184d-8d9a-528a-86e9-11d64f03f657
2026-03-28 19:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205
2026-03-28 19:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f22528e-21fa-5017-8422-f60b084097da with scrape type 1
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3f22528e-21fa-5017-8422-f60b084097da
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_424b50df96d1adf6761c48660f141c4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_424b50df96d1adf6761c48660f141c4f.jpg not downloaded yet
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_01b6155247eb375133041bc4ee861cf6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_f2d14fb02b68546f7cff51f941333ff2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_f2d14fb02b68546f7cff51f941333ff2.jpg not downloaded yet
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_9b9d9107b3d607b94cd1704507c29fe7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_9b9d9107b3d607b94cd1704507c29fe7.jpg not downloaded yet
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_cc90db3c316ab02e426c17245c828748.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_7bd506dd7bda545e41ddd6aaa496b8f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_7bd506dd7bda545e41ddd6aaa496b8f4.jpg not downloaded yet
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_e3e3b00503e00889579b52f1119fb696.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_4bc83bf6d0a40121870200705a47ab24.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_4bc83bf6d0a40121870200705a47ab24.jpg not downloaded yet
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_cba5f5249bc50be1b9937bf02592cb74.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_8712ea7dff6273326acdd975443c92da.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_8712ea7dff6273326acdd975443c92da.jpg not downloaded yet
2026-03-28 19:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_61752d4651517d3f7421778738123700.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e867ca10>
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_01b6155247eb375133041bc4ee861cf6.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_01b6155247eb375133041bc4ee861cf6.jpg saved to cache
2026-03-28 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8678a10>
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_cc90db3c316ab02e426c17245c828748.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_cc90db3c316ab02e426c17245c828748.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83d8e10>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_e3e3b00503e00889579b52f1119fb696.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_e3e3b00503e00889579b52f1119fb696.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_4bc83bf6d0a40121870200705a47ab24.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_7bd506dd7bda545e41ddd6aaa496b8f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD35327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83d8590>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_cba5f5249bc50be1b9937bf02592cb74.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_cba5f5249bc50be1b9937bf02592cb74.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3401a8b0-13c2-5a20-985d-597667095bfe
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e93f5650>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_61752d4651517d3f7421778738123700.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_61752d4651517d3f7421778738123700.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_9b9d9107b3d607b94cd1704507c29fe7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM51490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8668110>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_4bc83bf6d0a40121870200705a47ab24.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_4bc83bf6d0a40121870200705a47ab24.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f22528e-21fa-5017-8422-f60b084097da
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8638810>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_7bd506dd7bda545e41ddd6aaa496b8f4.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_7bd506dd7bda545e41ddd6aaa496b8f4.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f22528e-21fa-5017-8422-f60b084097da
2026-03-28 19:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_8712ea7dff6273326acdd975443c92da.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_424b50df96d1adf6761c48660f141c4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8466550>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_9b9d9107b3d607b94cd1704507c29fe7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_9b9d9107b3d607b94cd1704507c29fe7.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f22528e-21fa-5017-8422-f60b084097da
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83c1dd0>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_8712ea7dff6273326acdd975443c92da.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_8712ea7dff6273326acdd975443c92da.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f22528e-21fa-5017-8422-f60b084097da
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_f2d14fb02b68546f7cff51f941333ff2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e2790>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_424b50df96d1adf6761c48660f141c4f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_424b50df96d1adf6761c48660f141c4f.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f22528e-21fa-5017-8422-f60b084097da
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_62c1fdab821a95e72b1880286bb1a77e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_ed807d6796117098db640e7b64792190.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84690d0>
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fea%252F11ea14e499d2408531e7584c50420296%252Fpa%252FMF69205_f2d14fb02b68546f7cff51f941333ff2.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_f2d14fb02b68546f7cff51f941333ff2.jpg saved to cache
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f22528e-21fa-5017-8422-f60b084097da
2026-03-28 19:11:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f22528e-21fa-5017-8422-f60b084097da, skipping ID generation
2026-03-28 19:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f22528e-21fa-5017-8422-f60b084097da with scrape type 1
2026-03-28 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f22528e-21fa-5017-8422-f60b084097da sending to next pipeline
2026-03-28 19:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f22528e-21fa-5017-8422-f60b084097da, identifier: MF69205
2026-03-28 19:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205
2026-03-28 19:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205
2026-03-28 19:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205 to the API
2026-03-28 19:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_f2d14fb02b68546f7cff51f941333ff2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:42:13Z',
 'fuel_type': 'petrol',
 'id': '3f22528e-21fa-5017-8422-f60b084097da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '49JNR8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF69205',
 'listing': 'auction',
 'location': 'NL, Koog aan de Zaan',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 128460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_424b50df96d1adf6761c48660f141c4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_f2d14fb02b68546f7cff51f941333ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_9b9d9107b3d607b94cd1704507c29fe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_7bd506dd7bda545e41ddd6aaa496b8f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_4bc83bf6d0a40121870200705a47ab24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f22528e-21fa-5017-8422-f60b084097da/3f22528e-21fa-5017-8422-f60b084097da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ea/11ea14e499d2408531e7584c50420296/pa/MF69205_8712ea7dff6273326acdd975443c92da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF69205%27 HTTP/1.1" 200 None
2026-03-28 19:11:11 [auto1.nl] INFO: Saving data for MF69205: {'created_time': 1774725071.221292, 'last_price_update_time': 1774725071.221303, 'auction_closing_time': 1774885333.0}
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MF69205') HTTP/1.1" 204 0
2026-03-28 19:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_6c527ae01fc2ceeef8f434d546deec9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_b0a0a58d01a1e8bc6c2ec6d37ae30cb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR08670> (referer: https://www.auto1.com/v1/car-details-view/PR08670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB68589> (referer: https://www.auto1.com/v1/car-details-view/DB68589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW17706> (referer: https://www.auto1.com/v1/car-details-view/JW17706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8460750>
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ffe%252F05fea0b07fceefdd007191615cc8595d%252Fpa%252FVC21131_62c1fdab821a95e72b1880286bb1a77e.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_62c1fdab821a95e72b1880286bb1a77e.jpg saved to cache
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80
2026-03-28 19:11:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45c123dd-0dd6-58a4-86b2-cf7deed57d80, skipping ID generation
2026-03-28 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with scrape type 1
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80 sending to next pipeline
2026-03-28 19:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 45c123dd-0dd6-58a4-86b2-cf7deed57d80, identifier: VC21131
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e86888d0>
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_ed807d6796117098db640e7b64792190.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_ed807d6796117098db640e7b64792190.jpg saved to cache
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3401a8b0-13c2-5a20-985d-597667095bfe
2026-03-28 19:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131
2026-03-28 19:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131
2026-03-28 19:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131 to the API
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_62c1fdab821a95e72b1880286bb1a77e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'petrol',
 'id': '45c123dd-0dd6-58a4-86b2-cf7deed57d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '47RDG7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC21131',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 331075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_01b6155247eb375133041bc4ee861cf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_cc90db3c316ab02e426c17245c828748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_61752d4651517d3f7421778738123700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_e3e3b00503e00889579b52f1119fb696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c123dd-0dd6-58a4-86b2-cf7deed57d80/45c123dd-0dd6-58a4-86b2-cf7deed57d80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/fe/05fea0b07fceefdd007191615cc8595d/pa/VC21131_62c1fdab821a95e72b1880286bb1a77e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC21131%27 HTTP/1.1" 200 None
2026-03-28 19:11:11 [auto1.nl] INFO: Saving data for VC21131: {'created_time': 1774725071.786452, 'last_price_update_time': 1774725071.786461, 'auction_closing_time': 1774884714.0}
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC21131') HTTP/1.1" 204 0
2026-03-28 19:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_449e8fb4de73f55342b0c02dc426b0b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e0cd0>
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_6c527ae01fc2ceeef8f434d546deec9a.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_6c527ae01fc2ceeef8f434d546deec9a.jpg saved to cache
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3401a8b0-13c2-5a20-985d-597667095bfe
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83500d0>
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F43%252Fc44363a1c3fdca65c2cd9cd143b0d4c3%252Fpa%252FUR81542_b0a0a58d01a1e8bc6c2ec6d37ae30cb6.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_b0a0a58d01a1e8bc6c2ec6d37ae30cb6.jpg saved to cache
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3401a8b0-13c2-5a20-985d-597667095bfe
2026-03-28 19:11:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3401a8b0-13c2-5a20-985d-597667095bfe, skipping ID generation
2026-03-28 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3401a8b0-13c2-5a20-985d-597667095bfe with scrape type 1
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3401a8b0-13c2-5a20-985d-597667095bfe sending to next pipeline
2026-03-28 19:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3401a8b0-13c2-5a20-985d-597667095bfe, identifier: UR81542
2026-03-28 19:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670
2026-03-28 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfacca18-57fe-552a-b2ec-4360fc335b25 with scrape type 1
2026-03-28 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_3ffc9025cdd7ac0098957b22c91de5f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_3ffc9025cdd7ac0098957b22c91de5f1.jpg not downloaded yet
2026-03-28 19:11:12 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 646 | hits on page: 40
2026-03-28 19:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589
2026-03-28 19:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with scrape type 1
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_5a4bbed1c274b163d81eb9d444b758ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_5a4bbed1c274b163d81eb9d444b758ab.jpg not downloaded yet
2026-03-28 19:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706
2026-03-28 19:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with scrape type 1
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_97d40ab4fad62d356b99f82cddadd113.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_97d40ab4fad62d356b99f82cddadd113.jpg not downloaded yet
2026-03-28 19:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542
2026-03-28 19:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542
2026-03-28 19:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542 to the API
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_b0a0a58d01a1e8bc6c2ec6d37ae30cb6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:47:10Z',
 'fuel_type': 'petrol',
 'id': '3401a8b0-13c2-5a20-985d-597667095bfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '98NDP2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR81542',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 313934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_b0a0a58d01a1e8bc6c2ec6d37ae30cb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_cba5f5249bc50be1b9937bf02592cb74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_6c527ae01fc2ceeef8f434d546deec9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3401a8b0-13c2-5a20-985d-597667095bfe/3401a8b0-13c2-5a20-985d-597667095bfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/43/c44363a1c3fdca65c2cd9cd143b0d4c3/pa/UR81542_ed807d6796117098db640e7b64792190.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81542%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Saving data for UR81542: {'created_time': 1774725072.407087, 'last_price_update_time': 1774725072.407097, 'auction_closing_time': 1774885630.0}
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR81542') HTTP/1.1" 204 0
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_747c792a6f5fdb5953211834e63cd804.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_747c792a6f5fdb5953211834e63cd804.jpg not downloaded yet
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for JM32164: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for HM06318: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for KH60865: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for GS42620: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for YJ91466: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for PA65227: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for HG71940: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for MV57262: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for VS29188: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for ZZ45478: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for RW57039: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for HM15601: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for GP36316: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for UE83954: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for XG85677: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for SX97177: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for PF57895: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for HV92208: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for WY33906: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [auto1.nl] INFO: Scrape type for WN49119: 0
2026-03-28 19:11:12 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_66ed48b8ef3faeba07cd1c6405b9ad48.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_66ed48b8ef3faeba07cd1c6405b9ad48.jpg not downloaded yet
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_268868d71d096e3503ce17643a542016.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_268868d71d096e3503ce17643a542016.jpg not downloaded yet
2026-03-28 19:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG04233> (referer: https://www.auto1.com/v1/car-details-view/BG04233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e844aa90>
2026-03-28 19:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F86%252F6c86a64ee922c2d0d0d0acde980b38de%252Fpa%252FVC54517_449e8fb4de73f55342b0c02dc426b0b7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_449e8fb4de73f55342b0c02dc426b0b7.jpg saved to cache
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 305c184d-8d9a-528a-86e9-11d64f03f657
2026-03-28 19:11:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 305c184d-8d9a-528a-86e9-11d64f03f657, skipping ID generation
2026-03-28 19:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 305c184d-8d9a-528a-86e9-11d64f03f657 with scrape type 1
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 305c184d-8d9a-528a-86e9-11d64f03f657 sending to next pipeline
2026-03-28 19:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 305c184d-8d9a-528a-86e9-11d64f03f657, identifier: VC54517
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_144cd090b8313184c3740d6772c63e30.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_144cd090b8313184c3740d6772c63e30.jpg not downloaded yet
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_aeebadbf1f9a6e2b659df32225395830.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_aeebadbf1f9a6e2b659df32225395830.jpg not downloaded yet
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_82fed6f3ab08b3dfb14a597e79211456.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_82fed6f3ab08b3dfb14a597e79211456.jpg not downloaded yet
2026-03-28 19:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517
2026-03-28 19:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517
2026-03-28 19:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517 to the API
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_449e8fb4de73f55342b0c02dc426b0b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:47Z',
 'fuel_type': 'petrol',
 'id': '305c184d-8d9a-528a-86e9-11d64f03f657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '92TVP5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC54517',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 201690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_449e8fb4de73f55342b0c02dc426b0b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_c1c568d5ea9e8c86ae37f48941c27c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_2411203ef46ca776d554d999b52c0d35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_68a9b1a82bf8a7284c1cbc592b360b6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_305c184d-8d9a-528a-86e9-11d64f03f657/305c184d-8d9a-528a-86e9-11d64f03f657_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/86/6c86a64ee922c2d0d0d0acde980b38de/pa/VC54517_7353cdd9fbcf962b05e5c0a6feee7257.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC54517%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [auto1.nl] INFO: Saving data for VC54517: {'created_time': 1774725073.382362, 'last_price_update_time': 1774725073.382371, 'auction_closing_time': 1774883447.0}
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC54517') HTTP/1.1" 204 0
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_1dbf50aeead369a94cb49fd33ac50e29.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_1dbf50aeead369a94cb49fd33ac50e29.jpg not downloaded yet
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_2490df24fc5a95922caf304ffdc96c6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_2490df24fc5a95922caf304ffdc96c6c.jpg not downloaded yet
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_c27fece16a185ed2a439c8aa36e48c25.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_c27fece16a185ed2a439c8aa36e48c25.jpg not downloaded yet
2026-03-28 19:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP28763> (referer: https://www.auto1.com/v1/car-details-view/XP28763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_9a8d58d0fb5047be78f47d860610da4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_9a8d58d0fb5047be78f47d860610da4a.jpg not downloaded yet
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_f6adc394d4ae34979da200a24c11ac91.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f6adc394d4ae34979da200a24c11ac91.jpg not downloaded yet
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_e49214b0968339d810b4a9a7327fc28d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_e49214b0968339d810b4a9a7327fc28d.jpg not downloaded yet
2026-03-28 19:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233
2026-03-28 19:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58458355-b826-5983-adfc-801a3ea42012 with scrape type 1
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58458355-b826-5983-adfc-801a3ea42012
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_dd5ce3fa435a8a044edde75a08693045.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_dd5ce3fa435a8a044edde75a08693045.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_be27661dc8363c8db67a746d1c109edc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_be27661dc8363c8db67a746d1c109edc.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_1065c9356222c1cec455bef8d91a29d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_1065c9356222c1cec455bef8d91a29d6.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_746242bfca7e822f60a567cfe83dae0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_746242bfca7e822f60a567cfe83dae0d.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_debd36d9eba9658b1885032f1e5b3fa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_debd36d9eba9658b1885032f1e5b3fa6.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_2a044f59eb05ae43743c3f677d1ed761.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_2a044f59eb05ae43743c3f677d1ed761.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_7c6ab963732939749fd2875b09fa83f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_7c6ab963732939749fd2875b09fa83f6.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_b2754d54014d94674b78773005b724e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_b2754d54014d94674b78773005b724e9.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_4257b92856569c494ef68fd9b9b0350a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_4257b92856569c494ef68fd9b9b0350a.jpg already downloaded
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c143a7a9171d8be83673d8f4b22f%252Fpa%252FBG04233_b556c2a12381340e403686a918baaf23.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_b556c2a12381340e403686a918baaf23.jpg already downloaded
2026-03-28 19:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58458355-b826-5983-adfc-801a3ea42012, identifier: BG04233
2026-03-28 19:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233
2026-03-28 19:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233
2026-03-28 19:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233 to the API
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BG04233>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:47Z',
 'fuel_type': 'petrol',
 'id': '58458355-b826-5983-adfc-801a3ea42012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RR986R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG04233',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'BMW',
 'model': '3er',
 'odometer': 111228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_dd5ce3fa435a8a044edde75a08693045.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_be27661dc8363c8db67a746d1c109edc.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_1065c9356222c1cec455bef8d91a29d6.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_746242bfca7e822f60a567cfe83dae0d.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_debd36d9eba9658b1885032f1e5b3fa6.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_2a044f59eb05ae43743c3f677d1ed761.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_7c6ab963732939749fd2875b09fa83f6.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_b2754d54014d94674b78773005b724e9.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_4257b92856569c494ef68fd9b9b0350a.jpg',
                'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_b556c2a12381340e403686a918baaf23.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_dd5ce3fa435a8a044edde75a08693045.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_be27661dc8363c8db67a746d1c109edc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_1065c9356222c1cec455bef8d91a29d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_746242bfca7e822f60a567cfe83dae0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_debd36d9eba9658b1885032f1e5b3fa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_2a044f59eb05ae43743c3f677d1ed761.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_7c6ab963732939749fd2875b09fa83f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_b2754d54014d94674b78773005b724e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_4257b92856569c494ef68fd9b9b0350a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58458355-b826-5983-adfc-801a3ea42012/58458355-b826-5983-adfc-801a3ea42012_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c143a7a9171d8be83673d8f4b22f/pa/BG04233_b556c2a12381340e403686a918baaf23.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [auto1.nl] INFO: Saving data for BG04233: {'created_time': 1774725074.25527, 'last_price_update_time': 1774725074.255281, 'auction_closing_time': 1774886027.0}
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG04233') HTTP/1.1" 204 0
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_0278c335367e4c061f10479d395348cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_0278c335367e4c061f10479d395348cb.jpg not downloaded yet
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_9424133fb5870cbba378be66daf4b8b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_9424133fb5870cbba378be66daf4b8b5.jpg not downloaded yet
2026-03-28 19:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_268868d71d096e3503ce17643a542016.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763
2026-03-28 19:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1285dc26-211a-5a50-adf3-2270d56475fe with scrape type 1
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1285dc26-211a-5a50-adf3-2270d56475fe
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_6ca08847a29545ad3fd97d798fb78c2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_6ca08847a29545ad3fd97d798fb78c2c.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_44db79a1e050f99e3a38f50c9e88067e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_44db79a1e050f99e3a38f50c9e88067e.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_d5ec64e8af4450a627caa9f4bb45d0ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_d5ec64e8af4450a627caa9f4bb45d0ba.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_8568f123bb0d0e507c2bd234a062c136.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_8568f123bb0d0e507c2bd234a062c136.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_a6dc34a47a885bacd48ea95683d83d2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_a6dc34a47a885bacd48ea95683d83d2e.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_a18119a0fa40a33d0368ae0448ecde69.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_a18119a0fa40a33d0368ae0448ecde69.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_09aef4ba0ec1a360c420e570bf866f6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_09aef4ba0ec1a360c420e570bf866f6e.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_2a53bf3211bff5649c3e629ac226b815.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_2a53bf3211bff5649c3e629ac226b815.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_4f3ce4b6fa5d19d24f65e7af424f547a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_4f3ce4b6fa5d19d24f65e7af424f547a.jpg already downloaded
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3d%252F9f3d458ed6e8e5bdc24ae63431f2cd7d%252Fpa%252FXP28763_face502f9574674332e1e572ef2a47dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_face502f9574674332e1e572ef2a47dd.jpg already downloaded
2026-03-28 19:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1285dc26-211a-5a50-adf3-2270d56475fe, identifier: XP28763
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_497b985ff9b7b368398593ffd95b4e92.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_497b985ff9b7b368398593ffd95b4e92.jpg not downloaded yet
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_a1b5761000d70fe3c52be11e54ffa4dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_a1b5761000d70fe3c52be11e54ffa4dd.jpg not downloaded yet
2026-03-28 19:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763
2026-03-28 19:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763
2026-03-28 19:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763 to the API
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XP28763>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'petrol',
 'id': '1285dc26-211a-5a50-adf3-2270d56475fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '2KZB63',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP28763',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 209218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_6ca08847a29545ad3fd97d798fb78c2c.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_44db79a1e050f99e3a38f50c9e88067e.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_d5ec64e8af4450a627caa9f4bb45d0ba.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_8568f123bb0d0e507c2bd234a062c136.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_a6dc34a47a885bacd48ea95683d83d2e.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_a18119a0fa40a33d0368ae0448ecde69.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_09aef4ba0ec1a360c420e570bf866f6e.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_2a53bf3211bff5649c3e629ac226b815.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_4f3ce4b6fa5d19d24f65e7af424f547a.jpg',
                'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_face502f9574674332e1e572ef2a47dd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_6ca08847a29545ad3fd97d798fb78c2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2231681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_44db79a1e050f99e3a38f50c9e88067e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_d5ec64e8af4450a627caa9f4bb45d0ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_8568f123bb0d0e507c2bd234a062c136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_a6dc34a47a885bacd48ea95683d83d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_a18119a0fa40a33d0368ae0448ecde69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_09aef4ba0ec1a360c420e570bf866f6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_2a53bf3211bff5649c3e629ac226b815.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2188986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_4f3ce4b6fa5d19d24f65e7af424f547a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1285dc26-211a-5a50-adf3-2270d56475fe/1285dc26-211a-5a50-adf3-2270d56475fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2472943,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3d/9f3d458ed6e8e5bdc24ae63431f2cd7d/pa/XP28763_face502f9574674332e1e572ef2a47dd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-28 19:11:14 [auto1.nl] INFO: Saving data for XP28763: {'created_time': 1774725074.966806, 'last_price_update_time': 1774725074.966818, 'auction_closing_time': 1774883761.0}
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XP28763') HTTP/1.1" 204 0
2026-03-28 19:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_c27fece16a185ed2a439c8aa36e48c25.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_6a84c1bfd826e28fac1f16b9fc7764dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_6a84c1bfd826e28fac1f16b9fc7764dc.jpg not downloaded yet
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_f2f93a5e96da022e971cbc8149b8f133.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f2f93a5e96da022e971cbc8149b8f133.jpg not downloaded yet
2026-03-28 19:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP71821> (referer: https://www.auto1.com/v1/car-details-view/JP71821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ98625> (referer: https://www.auto1.com/v1/car-details-view/BZ98625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX19183> (referer: https://www.auto1.com/v1/car-details-view/KX19183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8453ed0>
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_268868d71d096e3503ce17643a542016.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_268868d71d096e3503ce17643a542016.jpg saved to cache
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8
2026-03-28 19:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM68754> (referer: https://www.auto1.com/v1/car-details-view/GM68754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_8ed92f30f059c26566edcebf040717e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_8ed92f30f059c26566edcebf040717e9.jpg not downloaded yet
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_4915b07b7ff9ddbc565979c2cf97e14f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_4915b07b7ff9ddbc565979c2cf97e14f.jpg not downloaded yet
2026-03-28 19:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_e49214b0968339d810b4a9a7327fc28d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD35327> (referer: https://www.auto1.com/v1/car-details-view/MD35327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_d3ff9579a966f923a2f5410ee64db7b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_d3ff9579a966f923a2f5410ee64db7b9.jpg not downloaded yet
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_cbf8d3c5e1437b2afe1c2e186c329322.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_cbf8d3c5e1437b2afe1c2e186c329322.jpg not downloaded yet
2026-03-28 19:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8511d10>
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_c27fece16a185ed2a439c8aa36e48c25.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_c27fece16a185ed2a439c8aa36e48c25.jpg saved to cache
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8
2026-03-28 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821
2026-03-28 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b300dc7b-9d15-52fe-b3e6-d5c827187e55 with scrape type 1
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_31ad203e4189fe0437130f22be639718.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_31ad203e4189fe0437130f22be639718.jpg not downloaded yet
2026-03-28 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625
2026-03-28 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with scrape type 1
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_03d7acbb40a99ccca6173616c382161b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_03d7acbb40a99ccca6173616c382161b.jpg not downloaded yet
2026-03-28 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183
2026-03-28 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with scrape type 1
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_2037763806307da2d6710cf17cbda4c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_2037763806307da2d6710cf17cbda4c4.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_8aea51d8ebee9f8e6f3e265996833919.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_8aea51d8ebee9f8e6f3e265996833919.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_455eff1ef2e7d600200d6c63d751fa15.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_455eff1ef2e7d600200d6c63d751fa15.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_a93a2c83348ab7120b9e2336324cb582.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_a93a2c83348ab7120b9e2336324cb582.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_91cfa6c52bfb14827f7a785064002543.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_91cfa6c52bfb14827f7a785064002543.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_d5c0a3082b508e33809d418ed1969e1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_d5c0a3082b508e33809d418ed1969e1b.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_d2ecd6fbe8f5c6637a1879afaf740407.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_d2ecd6fbe8f5c6637a1879afaf740407.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_7c58efd384579310919a5424581ae741.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_7c58efd384579310919a5424581ae741.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_0d3fc0afea59f62c99317b4b96b81d2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_0d3fc0afea59f62c99317b4b96b81d2a.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F8d%252Fbc8d76f733e645f45c9402442a9ad502%252Fpa%252FKX19183_4fc0d9bbed1e5b6049c626f1c5343628.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_4fc0d9bbed1e5b6049c626f1c5343628.jpg already downloaded
2026-03-28 19:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd, identifier: KX19183
2026-03-28 19:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183
2026-03-28 19:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183
2026-03-28 19:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183 to the API
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KX19183>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:27Z',
 'fuel_type': 'petrol',
 'id': '04cdf1a4-1c94-55ef-bc88-3b56b7b834dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RX702F',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX19183',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 151638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_2037763806307da2d6710cf17cbda4c4.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_8aea51d8ebee9f8e6f3e265996833919.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_455eff1ef2e7d600200d6c63d751fa15.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_a93a2c83348ab7120b9e2336324cb582.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_91cfa6c52bfb14827f7a785064002543.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_d5c0a3082b508e33809d418ed1969e1b.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_d2ecd6fbe8f5c6637a1879afaf740407.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_7c58efd384579310919a5424581ae741.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_0d3fc0afea59f62c99317b4b96b81d2a.jpg',
                'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_4fc0d9bbed1e5b6049c626f1c5343628.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_2037763806307da2d6710cf17cbda4c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380736,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_8aea51d8ebee9f8e6f3e265996833919.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_455eff1ef2e7d600200d6c63d751fa15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1931354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_a93a2c83348ab7120b9e2336324cb582.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_91cfa6c52bfb14827f7a785064002543.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_d5c0a3082b508e33809d418ed1969e1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_d2ecd6fbe8f5c6637a1879afaf740407.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_7c58efd384579310919a5424581ae741.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_0d3fc0afea59f62c99317b4b96b81d2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cdf1a4-1c94-55ef-bc88-3b56b7b834dd/04cdf1a4-1c94-55ef-bc88-3b56b7b834dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/8d/bc8d76f733e645f45c9402442a9ad502/pa/KX19183_4fc0d9bbed1e5b6049c626f1c5343628.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2011}
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [auto1.nl] INFO: Saving data for KX19183: {'created_time': 1774725075.840157, 'last_price_update_time': 1774725075.840167, 'auction_closing_time': 1774884267.0}
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX19183') HTTP/1.1" 204 0
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_9bec1601fb086eef8698f7679f7c8a9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9bec1601fb086eef8698f7679f7c8a9e.jpg not downloaded yet
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_cc1a03bc5c732f8fdbe4d2819e8aecb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_cc1a03bc5c732f8fdbe4d2819e8aecb8.jpg not downloaded yet
2026-03-28 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754
2026-03-28 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3754e0-6998-570e-8063-a7132f9bf4c7 with scrape type 1
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3f3754e0-6998-570e-8063-a7132f9bf4c7
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F23%252Fca23e9b108ad304424c06af81e19640f%252Fpa%252FGM68754_d943c79069577cb5bb53ed8cba251e9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_d943c79069577cb5bb53ed8cba251e9e.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F23%252Fca23e9b108ad304424c06af81e19640f%252Fpa%252FGM68754_dd6f3a43b7663c270223a564ec80de7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_dd6f3a43b7663c270223a564ec80de7f.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F23%252Fca23e9b108ad304424c06af81e19640f%252Fpa%252FGM68754_355d29d4768eaac43dc57f20dee58c85.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_355d29d4768eaac43dc57f20dee58c85.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F23%252Fca23e9b108ad304424c06af81e19640f%252Fpa%252FGM68754_482faef571128c397dc61ab634c25671.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_482faef571128c397dc61ab634c25671.jpg already downloaded
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F23%252Fca23e9b108ad304424c06af81e19640f%252Fpa%252FGM68754_4f5a0322e3b1316f8ec23cc36c77b1aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_4f5a0322e3b1316f8ec23cc36c77b1aa.jpg already downloaded
2026-03-28 19:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f3754e0-6998-570e-8063-a7132f9bf4c7, identifier: GM68754
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_9424133fb5870cbba378be66daf4b8b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_497b985ff9b7b368398593ffd95b4e92.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f2f93a5e96da022e971cbc8149b8f133.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_0278c335367e4c061f10479d395348cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754
2026-03-28 19:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754
2026-03-28 19:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754 to the API
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM68754>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:36:02Z',
 'fuel_type': 'petrol',
 'id': '3f3754e0-6998-570e-8063-a7132f9bf4c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '51SHV4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM68754',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 369511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_d943c79069577cb5bb53ed8cba251e9e.jpg',
                'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_dd6f3a43b7663c270223a564ec80de7f.jpg',
                'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_355d29d4768eaac43dc57f20dee58c85.jpg',
                'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_482faef571128c397dc61ab634c25671.jpg',
                'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_4f5a0322e3b1316f8ec23cc36c77b1aa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3754e0-6998-570e-8063-a7132f9bf4c7/3f3754e0-6998-570e-8063-a7132f9bf4c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_d943c79069577cb5bb53ed8cba251e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3754e0-6998-570e-8063-a7132f9bf4c7/3f3754e0-6998-570e-8063-a7132f9bf4c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_dd6f3a43b7663c270223a564ec80de7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3754e0-6998-570e-8063-a7132f9bf4c7/3f3754e0-6998-570e-8063-a7132f9bf4c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_355d29d4768eaac43dc57f20dee58c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3754e0-6998-570e-8063-a7132f9bf4c7/3f3754e0-6998-570e-8063-a7132f9bf4c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_482faef571128c397dc61ab634c25671.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3754e0-6998-570e-8063-a7132f9bf4c7/3f3754e0-6998-570e-8063-a7132f9bf4c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/23/ca23e9b108ad304424c06af81e19640f/pa/GM68754_4f5a0322e3b1316f8ec23cc36c77b1aa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2011}
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [auto1.nl] INFO: Saving data for GM68754: {'created_time': 1774725076.409635, 'last_price_update_time': 1774725076.409644, 'auction_closing_time': 1774884962.0}
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GM68754') HTTP/1.1" 204 0
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_e8d3c5b346426a88e13a80f26d20dd9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_e8d3c5b346426a88e13a80f26d20dd9c.jpg not downloaded yet
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_2bba809eb259094c5f911723e57ac943.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_2bba809eb259094c5f911723e57ac943.jpg not downloaded yet
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM51490> (referer: https://www.auto1.com/v1/car-details-view/AM51490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84bc2d0>
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_e49214b0968339d810b4a9a7327fc28d.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_e49214b0968339d810b4a9a7327fc28d.jpg saved to cache
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8
2026-03-28 19:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327
2026-03-28 19:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55efb71b-7c15-56d8-bb75-cbc941182b05 with scrape type 1
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 55efb71b-7c15-56d8-bb75-cbc941182b05
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_29ae6f970a5fcce5216ebcc3cbe62489.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_29ae6f970a5fcce5216ebcc3cbe62489.jpg not downloaded yet
2026-03-28 19:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_a2aae5d0046bab4064a486a618796cae.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_a2aae5d0046bab4064a486a618796cae.jpg not downloaded yet
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_9cc1433b40af195bc96aefacdfeaac71.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_9cc1433b40af195bc96aefacdfeaac71.jpg not downloaded yet
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_b7ea962a01faf08e60026cadcbc59d1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_b7ea962a01faf08e60026cadcbc59d1b.jpg not downloaded yet
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83f90d0>
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_9424133fb5870cbba378be66daf4b8b5.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_9424133fb5870cbba378be66daf4b8b5.jpg saved to cache
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8638590>
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_497b985ff9b7b368398593ffd95b4e92.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_497b985ff9b7b368398593ffd95b4e92.jpg saved to cache
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6eadfa250>
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_f2f93a5e96da022e971cbc8149b8f133.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f2f93a5e96da022e971cbc8149b8f133.jpg saved to cache
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8766fd0>
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_0278c335367e4c061f10479d395348cb.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_0278c335367e4c061f10479d395348cb.jpg saved to cache
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_236c6615a8826d8c1846cdc895a2cbcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_236c6615a8826d8c1846cdc895a2cbcf.jpg not downloaded yet
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_b3eef6de2882b9deb0f18b9fac3ccbb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b3eef6de2882b9deb0f18b9fac3ccbb2.jpg not downloaded yet
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_6e8e1e574fbcda9abf58e0ccf5b22d3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_6e8e1e574fbcda9abf58e0ccf5b22d3e.jpg not downloaded yet
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_31ad203e4189fe0437130f22be639718.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_03d7acbb40a99ccca6173616c382161b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_cc1a03bc5c732f8fdbe4d2819e8aecb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9bec1601fb086eef8698f7679f7c8a9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490
2026-03-28 19:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with scrape type 1
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0916bfb-102e-5f67-bee4-ca18b2f0ece2
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_4bcae431397bdf52bea684cfa68673e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_4bcae431397bdf52bea684cfa68673e6.jpg already downloaded
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_8d4a8253b8bb0b4732e3556c9ca8a786.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_8d4a8253b8bb0b4732e3556c9ca8a786.jpg already downloaded
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_df136a43b0fe0945f6bccaedfa87e33c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_df136a43b0fe0945f6bccaedfa87e33c.jpg already downloaded
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_4ed8b0a9da95484499355a9db82d45af.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_4ed8b0a9da95484499355a9db82d45af.jpg already downloaded
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_11c29814f22e705f7e875501ce1c887b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_11c29814f22e705f7e875501ce1c887b.jpg already downloaded
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_b0364691f46ef6d534dc82bf41a597f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_b0364691f46ef6d534dc82bf41a597f8.jpg already downloaded
2026-03-28 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_e69a135900c9c0aa45adce84f3def571.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_e69a135900c9c0aa45adce84f3def571.jpg already downloaded
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_72af7e344d3262a74b4d0b42a1b7cd21.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_72af7e344d3262a74b4d0b42a1b7cd21.jpg already downloaded
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_2b8f0b8f831fff66ea3730f5369e19b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_2b8f0b8f831fff66ea3730f5369e19b0.jpg already downloaded
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F06%252Fb4068ccde6d3bebd1ea379a0948022f1%252Fpa%252FAM51490_ac8012d092cd4cd388cbc803933041f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_ac8012d092cd4cd388cbc803933041f6.jpg already downloaded
2026-03-28 19:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d0916bfb-102e-5f67-bee4-ca18b2f0ece2, identifier: AM51490
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_4222579ec82bf7615bc3b2ccb4c827b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_4222579ec82bf7615bc3b2ccb4c827b0.jpg not downloaded yet
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_67e070f90067399b3bb59a8cff0d8f2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_67e070f90067399b3bb59a8cff0d8f2f.jpg not downloaded yet
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_4151f92239ee1fd978c10c59b1ad6dc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_4151f92239ee1fd978c10c59b1ad6dc7.jpg not downloaded yet
2026-03-28 19:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490
2026-03-28 19:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490
2026-03-28 19:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490 to the API
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM51490>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': 'd0916bfb-102e-5f67-bee4-ca18b2f0ece2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZL-990-X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM51490',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '3er',
 'odometer': 101589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_4bcae431397bdf52bea684cfa68673e6.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_8d4a8253b8bb0b4732e3556c9ca8a786.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_df136a43b0fe0945f6bccaedfa87e33c.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_4ed8b0a9da95484499355a9db82d45af.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_11c29814f22e705f7e875501ce1c887b.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_b0364691f46ef6d534dc82bf41a597f8.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_e69a135900c9c0aa45adce84f3def571.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_72af7e344d3262a74b4d0b42a1b7cd21.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_2b8f0b8f831fff66ea3730f5369e19b0.jpg',
                'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_ac8012d092cd4cd388cbc803933041f6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_4bcae431397bdf52bea684cfa68673e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_8d4a8253b8bb0b4732e3556c9ca8a786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_df136a43b0fe0945f6bccaedfa87e33c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_4ed8b0a9da95484499355a9db82d45af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_11c29814f22e705f7e875501ce1c887b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_b0364691f46ef6d534dc82bf41a597f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_e69a135900c9c0aa45adce84f3def571.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_72af7e344d3262a74b4d0b42a1b7cd21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_2b8f0b8f831fff66ea3730f5369e19b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0916bfb-102e-5f67-bee4-ca18b2f0ece2/d0916bfb-102e-5f67-bee4-ca18b2f0ece2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/06/b4068ccde6d3bebd1ea379a0948022f1/pa/AM51490_ac8012d092cd4cd388cbc803933041f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2019}
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [auto1.nl] INFO: Saving data for AM51490: {'created_time': 1774725077.553574, 'last_price_update_time': 1774725077.553583, 'auction_closing_time': 1774884768.0}
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM51490') HTTP/1.1" 204 0
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_cbf8d3c5e1437b2afe1c2e186c329322.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_ef79f450e62449757c8aa2f1ce4a2c79.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_ef79f450e62449757c8aa2f1ce4a2c79.jpg not downloaded yet
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_b183cd8ae58180bb1d25bfdb70ba8f87.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b183cd8ae58180bb1d25bfdb70ba8f87.jpg not downloaded yet
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_2bfd20b18e4e1c8be4785d0a539178e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_2bfd20b18e4e1c8be4785d0a539178e2.jpg not downloaded yet
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB08844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8607210>
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_31ad203e4189fe0437130f22be639718.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_31ad203e4189fe0437130f22be639718.jpg saved to cache
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8394310>
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_03d7acbb40a99ccca6173616c382161b.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_03d7acbb40a99ccca6173616c382161b.jpg saved to cache
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85127d0>
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_cc1a03bc5c732f8fdbe4d2819e8aecb8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_cc1a03bc5c732f8fdbe4d2819e8aecb8.jpg saved to cache
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85363d0>
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_9bec1601fb086eef8698f7679f7c8a9e.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9bec1601fb086eef8698f7679f7c8a9e.jpg saved to cache
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF41961> (referer: https://www.auto1.com/v1/car-details-view/RF41961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD18286/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC40672> (referer: https://www.auto1.com/v1/car-details-view/BC40672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH69810> (referer: https://www.auto1.com/v1/car-details-view/DH69810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_eb0fc5d652a684aebfee63207060124b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_eb0fc5d652a684aebfee63207060124b.jpg not downloaded yet
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_895b0a020db4945d2d7a0a83cbdd6d9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_895b0a020db4945d2d7a0a83cbdd6d9a.jpg not downloaded yet
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_29ae6f970a5fcce5216ebcc3cbe62489.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_a2aae5d0046bab4064a486a618796cae.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_b7ea962a01faf08e60026cadcbc59d1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_9cc1433b40af195bc96aefacdfeaac71.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e819e9d0>
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_cbf8d3c5e1437b2afe1c2e186c329322.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_cbf8d3c5e1437b2afe1c2e186c329322.jpg saved to cache
2026-03-28 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_9d792ae29f7d3e4bffd444cea3896a0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9d792ae29f7d3e4bffd444cea3896a0f.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_d23521dcf707a0b82cec47dc0792eaa4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_d23521dcf707a0b82cec47dc0792eaa4.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_1f889619a7c18cf4907ea927700e9511.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_1f889619a7c18cf4907ea927700e9511.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_0bc623cbec1c0d0a23ad2635f9724873.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_0bc623cbec1c0d0a23ad2635f9724873.jpg not downloaded yet
2026-03-28 19:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961
2026-03-28 19:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with scrape type 1
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_57e7952a27eef049dea7b9f39e4dc9c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_57e7952a27eef049dea7b9f39e4dc9c8.jpg not downloaded yet
2026-03-28 19:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672
2026-03-28 19:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888bc9db-6aca-564e-856a-1017eb9fe8d0 with scrape type 1
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_323b20858596566ef4184150b31a18f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_323b20858596566ef4184150b31a18f5.jpg not downloaded yet
2026-03-28 19:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810
2026-03-28 19:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with scrape type 1
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_fff87bbccf2de5ac94087e7f5db2d7fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_fff87bbccf2de5ac94087e7f5db2d7fb.jpg not downloaded yet
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_4151f92239ee1fd978c10c59b1ad6dc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_cfef8f3b12fb83ddcc76d70e61c50277.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_cfef8f3b12fb83ddcc76d70e61c50277.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_56b1777b0d163a8c7bca7b0613c87544.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_56b1777b0d163a8c7bca7b0613c87544.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_347048fb289119df4a4c7de0142793ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_347048fb289119df4a4c7de0142793ae.jpg not downloaded yet
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e86891d0>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_29ae6f970a5fcce5216ebcc3cbe62489.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_29ae6f970a5fcce5216ebcc3cbe62489.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55efb71b-7c15-56d8-bb75-cbc941182b05
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83f8950>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_a2aae5d0046bab4064a486a618796cae.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_a2aae5d0046bab4064a486a618796cae.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8448ed0>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_b7ea962a01faf08e60026cadcbc59d1b.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_b7ea962a01faf08e60026cadcbc59d1b.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55efb71b-7c15-56d8-bb75-cbc941182b05
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82eb210>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_9cc1433b40af195bc96aefacdfeaac71.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_9cc1433b40af195bc96aefacdfeaac71.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_ef79f450e62449757c8aa2f1ce4a2c79.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_528acff49cd89fdbaff483308c013209.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_528acff49cd89fdbaff483308c013209.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_b49a6df57af446fc9752514f48dfdcd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_b49a6df57af446fc9752514f48dfdcd1.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_65134b89d824493ba6b1596de5958ca8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_65134b89d824493ba6b1596de5958ca8.jpg not downloaded yet
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_67e070f90067399b3bb59a8cff0d8f2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b183cd8ae58180bb1d25bfdb70ba8f87.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_2bfd20b18e4e1c8be4785d0a539178e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS03610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e829cf50>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_4151f92239ee1fd978c10c59b1ad6dc7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_4151f92239ee1fd978c10c59b1ad6dc7.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55efb71b-7c15-56d8-bb75-cbc941182b05
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_6852d1d18bca7ded8a1eeba1632a7746.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_6852d1d18bca7ded8a1eeba1632a7746.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_51f771d24761fd73b7791182944cc878.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_51f771d24761fd73b7791182944cc878.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_8081ab96d37a0ea348287f731d9ae3c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_8081ab96d37a0ea348287f731d9ae3c3.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_ac3d2d5ab4fba6f5663e67621bf1bf4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_ac3d2d5ab4fba6f5663e67621bf1bf4c.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_ad533d56349e5b359be6648c6ae49b3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_ad533d56349e5b359be6648c6ae49b3f.jpg not downloaded yet
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_4222579ec82bf7615bc3b2ccb4c827b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_a6bb3d407c51bede2812b3b43087bef0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6bb3d407c51bede2812b3b43087bef0.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_d5f5d02fc57f05f7faec16e5c46492f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_d5f5d02fc57f05f7faec16e5c46492f6.jpg not downloaded yet
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84d6bd0>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_ef79f450e62449757c8aa2f1ce4a2c79.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_ef79f450e62449757c8aa2f1ce4a2c79.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84ff310>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_67e070f90067399b3bb59a8cff0d8f2f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_67e070f90067399b3bb59a8cff0d8f2f.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84671d0>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_b183cd8ae58180bb1d25bfdb70ba8f87.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b183cd8ae58180bb1d25bfdb70ba8f87.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8441550>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_2bfd20b18e4e1c8be4785d0a539178e2.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_2bfd20b18e4e1c8be4785d0a539178e2.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55efb71b-7c15-56d8-bb75-cbc941182b05
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_0f961f91882cd3b9798cff7fd1a38257.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_0f961f91882cd3b9798cff7fd1a38257.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_a8efde430678c5258c1b641f2a748bda.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_a8efde430678c5258c1b641f2a748bda.jpg not downloaded yet
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_236c6615a8826d8c1846cdc895a2cbcf.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_2bba809eb259094c5f911723e57ac943.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_6e8e1e574fbcda9abf58e0ccf5b22d3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b3eef6de2882b9deb0f18b9fac3ccbb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_407e3087fdcc7afec56b26b005f6a445.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_407e3087fdcc7afec56b26b005f6a445.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_7c1c5a9872bb72556110295784a8fb9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_7c1c5a9872bb72556110295784a8fb9c.jpg not downloaded yet
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_fff87bbccf2de5ac94087e7f5db2d7fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8726a90>
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_4222579ec82bf7615bc3b2ccb4c827b0.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_4222579ec82bf7615bc3b2ccb4c827b0.jpg saved to cache
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_a1b5761000d70fe3c52be11e54ffa4dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_323b20858596566ef4184150b31a18f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_a6199cbe99dbeff7ae6ce8ed19da05d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6199cbe99dbeff7ae6ce8ed19da05d7.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_f8f1777c3aaa03e7bcebaf31d215a9ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_f8f1777c3aaa03e7bcebaf31d215a9ba.jpg not downloaded yet
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_4915b07b7ff9ddbc565979c2cf97e14f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_cfef8f3b12fb83ddcc76d70e61c50277.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_741a5dc915b7f04fa53e9de9cacd033f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_741a5dc915b7f04fa53e9de9cacd033f.jpg not downloaded yet
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_3e7cf3c4e43303f62fcef16c670201f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_3e7cf3c4e43303f62fcef16c670201f6.jpg not downloaded yet
2026-03-28 19:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_56b1777b0d163a8c7bca7b0613c87544.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8661e90>
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_236c6615a8826d8c1846cdc895a2cbcf.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_236c6615a8826d8c1846cdc895a2cbcf.jpg saved to cache
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83cb910>
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_2bba809eb259094c5f911723e57ac943.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_2bba809eb259094c5f911723e57ac943.jpg saved to cache
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8455550>
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9b%252F8d9b33aa66e2a90e15c73240683cdfdb%252Fpa%252FMD35327_6e8e1e574fbcda9abf58e0ccf5b22d3e.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_6e8e1e574fbcda9abf58e0ccf5b22d3e.jpg saved to cache
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55efb71b-7c15-56d8-bb75-cbc941182b05
2026-03-28 19:11:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55efb71b-7c15-56d8-bb75-cbc941182b05, skipping ID generation
2026-03-28 19:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55efb71b-7c15-56d8-bb75-cbc941182b05 with scrape type 1
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55efb71b-7c15-56d8-bb75-cbc941182b05 sending to next pipeline
2026-03-28 19:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 55efb71b-7c15-56d8-bb75-cbc941182b05, identifier: MD35327
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8776210>
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_b3eef6de2882b9deb0f18b9fac3ccbb2.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b3eef6de2882b9deb0f18b9fac3ccbb2.jpg saved to cache
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8352750>
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_fff87bbccf2de5ac94087e7f5db2d7fb.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_fff87bbccf2de5ac94087e7f5db2d7fb.jpg saved to cache
2026-03-28 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327
2026-03-28 19:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327
2026-03-28 19:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327 to the API
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_6e8e1e574fbcda9abf58e0ccf5b22d3e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:14:30Z',
 'fuel_type': 'petrol',
 'id': '55efb71b-7c15-56d8-bb75-cbc941182b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '6TLS94',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD35327',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'Fiat',
 'model': '500',
 'odometer': 149738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_29ae6f970a5fcce5216ebcc3cbe62489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_b7ea962a01faf08e60026cadcbc59d1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_6e8e1e574fbcda9abf58e0ccf5b22d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_4151f92239ee1fd978c10c59b1ad6dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55efb71b-7c15-56d8-bb75-cbc941182b05/55efb71b-7c15-56d8-bb75-cbc941182b05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9b/8d9b33aa66e2a90e15c73240683cdfdb/pa/MD35327_2bfd20b18e4e1c8be4785d0a539178e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2011}
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD35327%27 HTTP/1.1" 200 None
2026-03-28 19:11:19 [auto1.nl] INFO: Saving data for MD35327: {'created_time': 1774725079.975572, 'last_price_update_time': 1774725079.975581, 'auction_closing_time': 1774883670.0}
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD35327') HTTP/1.1" 204 0
2026-03-28 19:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_347048fb289119df4a4c7de0142793ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_ac3d2d5ab4fba6f5663e67621bf1bf4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_65134b89d824493ba6b1596de5958ca8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_d5f5d02fc57f05f7faec16e5c46492f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_6a84c1bfd826e28fac1f16b9fc7764dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_8081ab96d37a0ea348287f731d9ae3c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8509050>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_a1b5761000d70fe3c52be11e54ffa4dd.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_a1b5761000d70fe3c52be11e54ffa4dd.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8321510>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_323b20858596566ef4184150b31a18f5.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_323b20858596566ef4184150b31a18f5.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8488410>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_4915b07b7ff9ddbc565979c2cf97e14f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_4915b07b7ff9ddbc565979c2cf97e14f.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84fc750>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_cfef8f3b12fb83ddcc76d70e61c50277.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_cfef8f3b12fb83ddcc76d70e61c50277.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8488710>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_56b1777b0d163a8c7bca7b0613c87544.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_56b1777b0d163a8c7bca7b0613c87544.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV55742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e819db10>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_347048fb289119df4a4c7de0142793ae.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_347048fb289119df4a4c7de0142793ae.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8498050>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_ac3d2d5ab4fba6f5663e67621bf1bf4c.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_ac3d2d5ab4fba6f5663e67621bf1bf4c.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83233d0>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_65134b89d824493ba6b1596de5958ca8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_65134b89d824493ba6b1596de5958ca8.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84991d0>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_d5f5d02fc57f05f7faec16e5c46492f6.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_d5f5d02fc57f05f7faec16e5c46492f6.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84bf3d0>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_6a84c1bfd826e28fac1f16b9fc7764dc.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_6a84c1bfd826e28fac1f16b9fc7764dc.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e819db10>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_8081ab96d37a0ea348287f731d9ae3c3.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_8081ab96d37a0ea348287f731d9ae3c3.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6bb3d407c51bede2812b3b43087bef0.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_ad533d56349e5b359be6648c6ae49b3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS03610> (referer: https://www.auto1.com/v1/car-details-view/PS03610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82c7c50>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_a6bb3d407c51bede2812b3b43087bef0.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6bb3d407c51bede2812b3b43087bef0.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6199cbe99dbeff7ae6ce8ed19da05d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_741a5dc915b7f04fa53e9de9cacd033f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_f8f1777c3aaa03e7bcebaf31d215a9ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_3e7cf3c4e43303f62fcef16c670201f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_407e3087fdcc7afec56b26b005f6a445.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG42782> (referer: https://www.auto1.com/v1/car-details-view/WG42782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8665610>
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_ad533d56349e5b359be6648c6ae49b3f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_ad533d56349e5b359be6648c6ae49b3f.jpg saved to cache
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610
2026-03-28 19:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ceab952-c7a1-5a3f-a41b-5d8791306833 with scrape type 1
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4ceab952-c7a1-5a3f-a41b-5d8791306833
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_7fbb9d10c5cd1bdc1019a121ff16566e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_7fbb9d10c5cd1bdc1019a121ff16566e.jpg not downloaded yet
2026-03-28 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_6852d1d18bca7ded8a1eeba1632a7746.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_ec2d9e29a2fc0d0bd6e0be3316484465.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_ec2d9e29a2fc0d0bd6e0be3316484465.jpg not downloaded yet
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_32715791fddb7137d2d9d7f62d03ab2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_32715791fddb7137d2d9d7f62d03ab2d.jpg not downloaded yet
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e872e550>
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_a6199cbe99dbeff7ae6ce8ed19da05d7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6199cbe99dbeff7ae6ce8ed19da05d7.jpg saved to cache
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8509950>
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_741a5dc915b7f04fa53e9de9cacd033f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_741a5dc915b7f04fa53e9de9cacd033f.jpg saved to cache
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84d6bd0>
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_f8f1777c3aaa03e7bcebaf31d215a9ba.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_f8f1777c3aaa03e7bcebaf31d215a9ba.jpg saved to cache
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83db090>
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_3e7cf3c4e43303f62fcef16c670201f6.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_3e7cf3c4e43303f62fcef16c670201f6.jpg saved to cache
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8684050>
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_407e3087fdcc7afec56b26b005f6a445.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_407e3087fdcc7afec56b26b005f6a445.jpg saved to cache
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782
2026-03-28 19:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with scrape type 1
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55f9cc18-dd3e-5ba7-aab3-701e7daf1430
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_2a35ae7ecb03a1790edab561f8fc865b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_2a35ae7ecb03a1790edab561f8fc865b.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_0dca5b17a923ce672ae1ad402747ab4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_0dca5b17a923ce672ae1ad402747ab4d.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_4e84b8b75a8e42e6e0c0f69cfaffb7c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_4e84b8b75a8e42e6e0c0f69cfaffb7c4.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_f25f16947aaa9eea7089f48cc0af1159.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_f25f16947aaa9eea7089f48cc0af1159.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_32f073573a5a948fb911da47776e8499.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_32f073573a5a948fb911da47776e8499.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_1c8ee1ee861ec4a9634737ef0284954c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_1c8ee1ee861ec4a9634737ef0284954c.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_0dc299f7f54727c501b18471a88944e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_0dc299f7f54727c501b18471a88944e4.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_866783c33b9e40c91ec78136ca9209b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_866783c33b9e40c91ec78136ca9209b8.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_ea43e2842f72ab67c4a990cbefeac296.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_ea43e2842f72ab67c4a990cbefeac296.jpg already downloaded
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F83%252Fb7835b819b5d197e32b92f2d9b7b768f%252Fpa%252FWG42782_12105640ff25c83194ff74926e4274cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_12105640ff25c83194ff74926e4274cf.jpg already downloaded
2026-03-28 19:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430, identifier: WG42782
2026-03-28 19:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_57e7952a27eef049dea7b9f39e4dc9c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_51f771d24761fd73b7791182944cc878.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_305c9f3eaf2793fa992f6f258fcc4a3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_305c9f3eaf2793fa992f6f258fcc4a3c.jpg not downloaded yet
2026-03-28 19:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782
2026-03-28 19:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782
2026-03-28 19:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782 to the API
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG42782>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.5L',
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:10:38Z',
 'fuel_type': 'petrol',
 'id': '55f9cc18-dd3e-5ba7-aab3-701e7daf1430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NX-675-J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG42782',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 157110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_2a35ae7ecb03a1790edab561f8fc865b.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_0dca5b17a923ce672ae1ad402747ab4d.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_4e84b8b75a8e42e6e0c0f69cfaffb7c4.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_f25f16947aaa9eea7089f48cc0af1159.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_32f073573a5a948fb911da47776e8499.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_1c8ee1ee861ec4a9634737ef0284954c.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_0dc299f7f54727c501b18471a88944e4.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_866783c33b9e40c91ec78136ca9209b8.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_ea43e2842f72ab67c4a990cbefeac296.jpg',
                'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_12105640ff25c83194ff74926e4274cf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3229751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_2a35ae7ecb03a1790edab561f8fc865b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2986913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_0dca5b17a923ce672ae1ad402747ab4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3293568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_4e84b8b75a8e42e6e0c0f69cfaffb7c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_f25f16947aaa9eea7089f48cc0af1159.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2864706,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_32f073573a5a948fb911da47776e8499.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_1c8ee1ee861ec4a9634737ef0284954c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_0dc299f7f54727c501b18471a88944e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_866783c33b9e40c91ec78136ca9209b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_ea43e2842f72ab67c4a990cbefeac296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f9cc18-dd3e-5ba7-aab3-701e7daf1430/55f9cc18-dd3e-5ba7-aab3-701e7daf1430_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/83/b7835b819b5d197e32b92f2d9b7b768f/pa/WG42782_12105640ff25c83194ff74926e4274cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 400 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-28 19:11:21 [auto1.nl] INFO: Saving data for WG42782: {'created_time': 1774725081.977534, 'last_price_update_time': 1774725081.977546, 'auction_closing_time': 1774883438.0}
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG42782') HTTP/1.1" 204 0
2026-03-28 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_b49a6df57af446fc9752514f48dfdcd1.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_528acff49cd89fdbaff483308c013209.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_0bc623cbec1c0d0a23ad2635f9724873.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_486e3011a38d31117e01f0ecbc45c4c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_486e3011a38d31117e01f0ecbc45c4c8.jpg not downloaded yet
2026-03-28 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV55742> (referer: https://www.auto1.com/v1/car-details-view/PV55742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_e0387a48b75b7a6f017be16ba59a35e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_e0387a48b75b7a6f017be16ba59a35e7.jpg not downloaded yet
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8389bd0>
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_6852d1d18bca7ded8a1eeba1632a7746.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_6852d1d18bca7ded8a1eeba1632a7746.jpg saved to cache
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8473910>
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_57e7952a27eef049dea7b9f39e4dc9c8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_57e7952a27eef049dea7b9f39e4dc9c8.jpg saved to cache
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e838a9d0>
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_51f771d24761fd73b7791182944cc878.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_51f771d24761fd73b7791182944cc878.jpg saved to cache
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9d792ae29f7d3e4bffd444cea3896a0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_7fbb9d10c5cd1bdc1019a121ff16566e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_1f889619a7c18cf4907ea927700e9511.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85ff890>
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_b49a6df57af446fc9752514f48dfdcd1.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_b49a6df57af446fc9752514f48dfdcd1.jpg saved to cache
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e838ac90>
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F8e%252Fd18e54b802d847eedf88009a7261957e%252Fpa%252FRF41961_528acff49cd89fdbaff483308c013209.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_528acff49cd89fdbaff483308c013209.jpg saved to cache
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6
2026-03-28 19:11:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6, skipping ID generation
2026-03-28 19:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with scrape type 1
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 sending to next pipeline
2026-03-28 19:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6, identifier: RF41961
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea510c90>
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_0bc623cbec1c0d0a23ad2635f9724873.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_0bc623cbec1c0d0a23ad2635f9724873.jpg saved to cache
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742
2026-03-28 19:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e099d074-6494-54ac-87a1-586587e4e464 with scrape type 1
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e099d074-6494-54ac-87a1-586587e4e464
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_6fa02125f8a097c7e372fd7ba6f3c15a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_6fa02125f8a097c7e372fd7ba6f3c15a.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_bcb87637fa319014fd3c1168f2d772b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_bcb87637fa319014fd3c1168f2d772b2.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_3c09a78e3e3e12ea87d6ca183ca2f29d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_3c09a78e3e3e12ea87d6ca183ca2f29d.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_a7c89f15437e9b7817b0946ad0cbc9e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_a7c89f15437e9b7817b0946ad0cbc9e4.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_70ae4977be58d1574eb9fdd5389c1c25.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_70ae4977be58d1574eb9fdd5389c1c25.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_3174f0a1804a9df4c6bd996ba866e25c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_3174f0a1804a9df4c6bd996ba866e25c.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_58dcca0ce3e3683e2a13f2a5cb6b2bf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_58dcca0ce3e3683e2a13f2a5cb6b2bf7.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_c78029b54835ed87f3704bf528e3948f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_c78029b54835ed87f3704bf528e3948f.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_f070bbfc04c698dbfd3afcad0d9e440e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_f070bbfc04c698dbfd3afcad0d9e440e.jpg already downloaded
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7e%252F367e6069af3f38b73955ab89d3c01bfa%252Fpa%252FPV55742_af02f156005978128cd90d744a8debf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_af02f156005978128cd90d744a8debf1.jpg already downloaded
2026-03-28 19:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e099d074-6494-54ac-87a1-586587e4e464, identifier: PV55742
2026-03-28 19:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961
2026-03-28 19:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961
2026-03-28 19:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961 to the API
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_528acff49cd89fdbaff483308c013209.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 113,
 'expiration_date': '2026-03-30T15:41:49Z',
 'fuel_type': 'petrol',
 'id': '1d1ee20f-1889-5c57-a477-c3eeedcb09d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '83RBPX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF41961',
 'listing': 'auction',
 'location': 'NL, Ede',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 87794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_57e7952a27eef049dea7b9f39e4dc9c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_cfef8f3b12fb83ddcc76d70e61c50277.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_528acff49cd89fdbaff483308c013209.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1ee20f-1889-5c57-a477-c3eeedcb09d6/1d1ee20f-1889-5c57-a477-c3eeedcb09d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/8e/d18e54b802d847eedf88009a7261957e/pa/RF41961_6852d1d18bca7ded8a1eeba1632a7746.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-02-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Megane 1.6 Authentique',
 'transmission': 'automatic',
 'trim': 'Authentique',
 'year': 2005}
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF41961%27 HTTP/1.1" 200 None
2026-03-28 19:11:23 [auto1.nl] INFO: Saving data for RF41961: {'created_time': 1774725083.033136, 'last_price_update_time': 1774725083.033146, 'auction_closing_time': 1774885309.0}
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF41961') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742
2026-03-28 19:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742
2026-03-28 19:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742 to the API
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PV55742>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'petrol',
 'id': 'e099d074-6494-54ac-87a1-586587e4e464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SP967L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV55742',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'BMW',
 'model': '3er',
 'odometer': 201614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_6fa02125f8a097c7e372fd7ba6f3c15a.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_bcb87637fa319014fd3c1168f2d772b2.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_3c09a78e3e3e12ea87d6ca183ca2f29d.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_a7c89f15437e9b7817b0946ad0cbc9e4.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_70ae4977be58d1574eb9fdd5389c1c25.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_3174f0a1804a9df4c6bd996ba866e25c.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_58dcca0ce3e3683e2a13f2a5cb6b2bf7.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_c78029b54835ed87f3704bf528e3948f.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_f070bbfc04c698dbfd3afcad0d9e440e.jpg',
                'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_af02f156005978128cd90d744a8debf1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_6fa02125f8a097c7e372fd7ba6f3c15a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3091024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_bcb87637fa319014fd3c1168f2d772b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_3c09a78e3e3e12ea87d6ca183ca2f29d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_a7c89f15437e9b7817b0946ad0cbc9e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2494646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_70ae4977be58d1574eb9fdd5389c1c25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_3174f0a1804a9df4c6bd996ba866e25c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_58dcca0ce3e3683e2a13f2a5cb6b2bf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2502561,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_c78029b54835ed87f3704bf528e3948f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_f070bbfc04c698dbfd3afcad0d9e440e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e099d074-6494-54ac-87a1-586587e4e464/e099d074-6494-54ac-87a1-586587e4e464_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2168182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/7e/367e6069af3f38b73955ab89d3c01bfa/pa/PV55742_af02f156005978128cd90d744a8debf1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2018}
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-28 19:11:23 [auto1.nl] INFO: Saving data for PV55742: {'created_time': 1774725083.343463, 'last_price_update_time': 1774725083.343478, 'auction_closing_time': 1774885291.0}
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PV55742') HTTP/1.1" 204 0
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_0f961f91882cd3b9798cff7fd1a38257.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_895b0a020db4945d2d7a0a83cbdd6d9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_d23521dcf707a0b82cec47dc0792eaa4.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_32715791fddb7137d2d9d7f62d03ab2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_ec2d9e29a2fc0d0bd6e0be3316484465.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_eb0fc5d652a684aebfee63207060124b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e871ff10>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_9d792ae29f7d3e4bffd444cea3896a0f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9d792ae29f7d3e4bffd444cea3896a0f.jpg saved to cache
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8441cd0>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_7fbb9d10c5cd1bdc1019a121ff16566e.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_7fbb9d10c5cd1bdc1019a121ff16566e.jpg saved to cache
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ceab952-c7a1-5a3f-a41b-5d8791306833
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83a6bd0>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_1f889619a7c18cf4907ea927700e9511.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_1f889619a7c18cf4907ea927700e9511.jpg saved to cache
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB08844> (referer: https://www.auto1.com/v1/car-details-view/EB08844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD18286> (referer: https://www.auto1.com/v1/car-details-view/MD18286/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_a8efde430678c5258c1b641f2a748bda.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e860b3d0>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F80%252F32805ab7d8f01fef8c86f5957513ef49%252Fpa%252FBC40672_0f961f91882cd3b9798cff7fd1a38257.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_0f961f91882cd3b9798cff7fd1a38257.jpg saved to cache
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 888bc9db-6aca-564e-856a-1017eb9fe8d0
2026-03-28 19:11:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 888bc9db-6aca-564e-856a-1017eb9fe8d0, skipping ID generation
2026-03-28 19:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888bc9db-6aca-564e-856a-1017eb9fe8d0 with scrape type 1
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 888bc9db-6aca-564e-856a-1017eb9fe8d0 sending to next pipeline
2026-03-28 19:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 888bc9db-6aca-564e-856a-1017eb9fe8d0, identifier: BC40672
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea51f510>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_895b0a020db4945d2d7a0a83cbdd6d9a.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_895b0a020db4945d2d7a0a83cbdd6d9a.jpg saved to cache
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8725210>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F34%252F0634c142a421751305716422c148df8d%252Fpa%252FBZ98625_d23521dcf707a0b82cec47dc0792eaa4.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_d23521dcf707a0b82cec47dc0792eaa4.jpg saved to cache
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85
2026-03-28 19:11:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18b7197c-ab02-5d31-b33b-0de3f73c7c85, skipping ID generation
2026-03-28 19:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with scrape type 1
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85 sending to next pipeline
2026-03-28 19:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 18b7197c-ab02-5d31-b33b-0de3f73c7c85, identifier: BZ98625
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e837f9d0>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_32715791fddb7137d2d9d7f62d03ab2d.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_32715791fddb7137d2d9d7f62d03ab2d.jpg saved to cache
2026-03-28 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ceab952-c7a1-5a3f-a41b-5d8791306833
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e867ea90>
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_ec2d9e29a2fc0d0bd6e0be3316484465.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_ec2d9e29a2fc0d0bd6e0be3316484465.jpg saved to cache
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ceab952-c7a1-5a3f-a41b-5d8791306833
2026-03-28 19:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82d1190>
2026-03-28 19:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_eb0fc5d652a684aebfee63207060124b.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_eb0fc5d652a684aebfee63207060124b.jpg saved to cache
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672
2026-03-28 19:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672
2026-03-28 19:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672 to the API
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_0f961f91882cd3b9798cff7fd1a38257.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:53:40Z',
 'fuel_type': 'petrol',
 'id': '888bc9db-6aca-564e-856a-1017eb9fe8d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TP828H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC40672',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'DS Automobiles',
 'model': 'DS3',
 'odometer': 106455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_323b20858596566ef4184150b31a18f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_56b1777b0d163a8c7bca7b0613c87544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_b49a6df57af446fc9752514f48dfdcd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_51f771d24761fd73b7791182944cc878.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_ac3d2d5ab4fba6f5663e67621bf1bf4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6bb3d407c51bede2812b3b43087bef0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2347185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_0f961f91882cd3b9798cff7fd1a38257.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_407e3087fdcc7afec56b26b005f6a445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_a6199cbe99dbeff7ae6ce8ed19da05d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888bc9db-6aca-564e-856a-1017eb9fe8d0/888bc9db-6aca-564e-856a-1017eb9fe8d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/80/32805ab7d8f01fef8c86f5957513ef49/pa/BC40672_741a5dc915b7f04fa53e9de9cacd033f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 1.6 THP SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2016}
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC40672%27 HTTP/1.1" 200 None
2026-03-28 19:11:24 [auto1.nl] INFO: Saving data for BC40672: {'created_time': 1774725084.428186, 'last_price_update_time': 1774725084.428198, 'auction_closing_time': 1774886020.0}
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC40672') HTTP/1.1" 204 0
2026-03-28 19:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625
2026-03-28 19:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625
2026-03-28 19:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625 to the API
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_d23521dcf707a0b82cec47dc0792eaa4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:06:43Z',
 'fuel_type': 'petrol',
 'id': '18b7197c-ab02-5d31-b33b-0de3f73c7c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '94-PLG-1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ98625',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 153417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_03d7acbb40a99ccca6173616c382161b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_cc1a03bc5c732f8fdbe4d2819e8aecb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_2bba809eb259094c5f911723e57ac943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_9cc1433b40af195bc96aefacdfeaac71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b3eef6de2882b9deb0f18b9fac3ccbb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_67e070f90067399b3bb59a8cff0d8f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_b183cd8ae58180bb1d25bfdb70ba8f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_895b0a020db4945d2d7a0a83cbdd6d9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_d23521dcf707a0b82cec47dc0792eaa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18b7197c-ab02-5d31-b33b-0de3f73c7c85/18b7197c-ab02-5d31-b33b-0de3f73c7c85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/34/0634c142a421751305716422c148df8d/pa/BZ98625_0bc623cbec1c0d0a23ad2635f9724873.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ98625%27 HTTP/1.1" 200 None
2026-03-28 19:11:24 [auto1.nl] INFO: Saving data for BZ98625: {'created_time': 1774725084.847055, 'last_price_update_time': 1774725084.847069, 'auction_closing_time': 1774883203.0}
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ98625') HTTP/1.1" 204 0
2026-03-28 19:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_486e3011a38d31117e01f0ecbc45c4c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_305c9f3eaf2793fa992f6f258fcc4a3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_e0387a48b75b7a6f017be16ba59a35e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_d3ff9579a966f923a2f5410ee64db7b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_e8d3c5b346426a88e13a80f26d20dd9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_8ed92f30f059c26566edcebf040717e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844
2026-03-28 19:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 190e717f-ff9a-5b59-88b1-d88d712596ee with scrape type 1
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 190e717f-ff9a-5b59-88b1-d88d712596ee
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_38290224344f2f23fa99694dec98ac81.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_38290224344f2f23fa99694dec98ac81.jpg already downloaded
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_efeebc5f30983b7161f2cc40f3fdc52f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_efeebc5f30983b7161f2cc40f3fdc52f.jpg already downloaded
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_493090a84d11c6d03793f3bdce46f296.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_493090a84d11c6d03793f3bdce46f296.jpg already downloaded
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_f4ecaf1ae7e4f9ea789d5ad8b173ecaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_f4ecaf1ae7e4f9ea789d5ad8b173ecaa.jpg already downloaded
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_5fb1770e1fac04e17cf3a864b9cb7e19.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_5fb1770e1fac04e17cf3a864b9cb7e19.jpg already downloaded
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_59f24aa8785d56fb061bdea172e9b192.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_59f24aa8785d56fb061bdea172e9b192.jpg already downloaded
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_3c09b722ceb50621daaadfe1325346b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_3c09b722ceb50621daaadfe1325346b4.jpg already downloaded
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_2e11afe17a63c0ae0eef9184a8eedb4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_2e11afe17a63c0ae0eef9184a8eedb4e.jpg already downloaded
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_2e055db0c5d4a226e040bcf0348842da.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_2e055db0c5d4a226e040bcf0348842da.jpg already downloaded
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F5c%252F815c36850b974f327eaa447954f69927%252Fpa%252FEB08844_f239f83533a3cde2781a0f82818718f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_f239f83533a3cde2781a0f82818718f9.jpg already downloaded
2026-03-28 19:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 190e717f-ff9a-5b59-88b1-d88d712596ee, identifier: EB08844
2026-03-28 19:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286
2026-03-28 19:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2ca630-420e-5a93-8498-d64476322ff4 with scrape type 1
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6d2ca630-420e-5a93-8498-d64476322ff4
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_7653d19fe6ddc9a3202b335b26f8db0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_7653d19fe6ddc9a3202b335b26f8db0e.jpg not downloaded yet
2026-03-28 19:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85fe450>
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_a8efde430678c5258c1b641f2a748bda.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_a8efde430678c5258c1b641f2a748bda.jpg saved to cache
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844
2026-03-28 19:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844
2026-03-28 19:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844 to the API
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EB08844>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'petrol',
 'id': '190e717f-ff9a-5b59-88b1-d88d712596ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RH428V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB08844',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 69788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_38290224344f2f23fa99694dec98ac81.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_efeebc5f30983b7161f2cc40f3fdc52f.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_493090a84d11c6d03793f3bdce46f296.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_f4ecaf1ae7e4f9ea789d5ad8b173ecaa.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_5fb1770e1fac04e17cf3a864b9cb7e19.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_59f24aa8785d56fb061bdea172e9b192.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_3c09b722ceb50621daaadfe1325346b4.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_2e11afe17a63c0ae0eef9184a8eedb4e.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_2e055db0c5d4a226e040bcf0348842da.jpg',
                'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_f239f83533a3cde2781a0f82818718f9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2273466,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_38290224344f2f23fa99694dec98ac81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2092609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_efeebc5f30983b7161f2cc40f3fdc52f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2392473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_493090a84d11c6d03793f3bdce46f296.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2306146,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_f4ecaf1ae7e4f9ea789d5ad8b173ecaa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_5fb1770e1fac04e17cf3a864b9cb7e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_59f24aa8785d56fb061bdea172e9b192.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2266852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_3c09b722ceb50621daaadfe1325346b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313190,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_2e11afe17a63c0ae0eef9184a8eedb4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_2e055db0c5d4a226e040bcf0348842da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190e717f-ff9a-5b59-88b1-d88d712596ee/190e717f-ff9a-5b59-88b1-d88d712596ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/5c/815c36850b974f327eaa447954f69927/pa/EB08844_f239f83533a3cde2781a0f82818718f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [auto1.nl] INFO: Saving data for EB08844: {'created_time': 1774725085.682537, 'last_price_update_time': 1774725085.682548, 'auction_closing_time': 1774883872.0}
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB08844') HTTP/1.1" 204 0
2026-03-28 19:11:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_7c1c5a9872bb72556110295784a8fb9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_9033833bf3e62bdf2fc56db32f09eb54.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_9033833bf3e62bdf2fc56db32f09eb54.jpg not downloaded yet
2026-03-28 19:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_82fed6f3ab08b3dfb14a597e79211456.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_2490df24fc5a95922caf304ffdc96c6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_9a8d58d0fb5047be78f47d860610da4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_1dbf50aeead369a94cb49fd33ac50e29.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83b2f50>
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_486e3011a38d31117e01f0ecbc45c4c8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_486e3011a38d31117e01f0ecbc45c4c8.jpg saved to cache
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ceab952-c7a1-5a3f-a41b-5d8791306833
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e855bf90>
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_305c9f3eaf2793fa992f6f258fcc4a3c.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_305c9f3eaf2793fa992f6f258fcc4a3c.jpg saved to cache
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ceab952-c7a1-5a3f-a41b-5d8791306833
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e16d0>
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fb3%252Fc6b3bc109548f3c183286a6c36e8cef3%252Fpa%252FPS03610_e0387a48b75b7a6f017be16ba59a35e7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_e0387a48b75b7a6f017be16ba59a35e7.jpg saved to cache
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ceab952-c7a1-5a3f-a41b-5d8791306833
2026-03-28 19:11:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ceab952-c7a1-5a3f-a41b-5d8791306833, skipping ID generation
2026-03-28 19:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ceab952-c7a1-5a3f-a41b-5d8791306833 with scrape type 1
2026-03-28 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ceab952-c7a1-5a3f-a41b-5d8791306833 sending to next pipeline
2026-03-28 19:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ceab952-c7a1-5a3f-a41b-5d8791306833, identifier: PS03610
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8724850>
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_d3ff9579a966f923a2f5410ee64db7b9.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_d3ff9579a966f923a2f5410ee64db7b9.jpg saved to cache
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8558990>
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F86%252Fcf869c0a80ea1ec24c2855145e87e960%252Fpa%252FJP71821_e8d3c5b346426a88e13a80f26d20dd9c.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_e8d3c5b346426a88e13a80f26d20dd9c.jpg saved to cache
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b300dc7b-9d15-52fe-b3e6-d5c827187e55
2026-03-28 19:11:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b300dc7b-9d15-52fe-b3e6-d5c827187e55, skipping ID generation
2026-03-28 19:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b300dc7b-9d15-52fe-b3e6-d5c827187e55 with scrape type 1
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b300dc7b-9d15-52fe-b3e6-d5c827187e55 sending to next pipeline
2026-03-28 19:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b300dc7b-9d15-52fe-b3e6-d5c827187e55, identifier: JP71821
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82f9f90>
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_8ed92f30f059c26566edcebf040717e9.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_8ed92f30f059c26566edcebf040717e9.jpg saved to cache
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_144cd090b8313184c3740d6772c63e30.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_07db97671875c5361931a5a16a2e2e6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_07db97671875c5361931a5a16a2e2e6c.jpg not downloaded yet
2026-03-28 19:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610
2026-03-28 19:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610
2026-03-28 19:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610 to the API
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_e0387a48b75b7a6f017be16ba59a35e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:45:16Z',
 'fuel_type': 'petrol',
 'id': '4ceab952-c7a1-5a3f-a41b-5d8791306833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '89hxt9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS03610',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 187170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_7fbb9d10c5cd1bdc1019a121ff16566e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_ec2d9e29a2fc0d0bd6e0be3316484465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_32715791fddb7137d2d9d7f62d03ab2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_305c9f3eaf2793fa992f6f258fcc4a3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_486e3011a38d31117e01f0ecbc45c4c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ceab952-c7a1-5a3f-a41b-5d8791306833/4ceab952-c7a1-5a3f-a41b-5d8791306833_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/b3/c6b3bc109548f3c183286a6c36e8cef3/pa/PS03610_e0387a48b75b7a6f017be16ba59a35e7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2009}
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS03610%27 HTTP/1.1" 200 None
2026-03-28 19:11:26 [auto1.nl] INFO: Saving data for PS03610: {'created_time': 1774725086.579861, 'last_price_update_time': 1774725086.579871, 'auction_closing_time': 1774885516.0}
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS03610') HTTP/1.1" 204 0
2026-03-28 19:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821
2026-03-28 19:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821
2026-03-28 19:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821 to the API
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_e8d3c5b346426a88e13a80f26d20dd9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:34:31Z',
 'fuel_type': 'hybrid',
 'id': 'b300dc7b-9d15-52fe-b3e6-d5c827187e55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NK880R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP71821',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 58984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_31ad203e4189fe0437130f22be639718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9bec1601fb086eef8698f7679f7c8a9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_e8d3c5b346426a88e13a80f26d20dd9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_a2aae5d0046bab4064a486a618796cae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_236c6615a8826d8c1846cdc895a2cbcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_4222579ec82bf7615bc3b2ccb4c827b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_ef79f450e62449757c8aa2f1ce4a2c79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_eb0fc5d652a684aebfee63207060124b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_9d792ae29f7d3e4bffd444cea3896a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b300dc7b-9d15-52fe-b3e6-d5c827187e55/b300dc7b-9d15-52fe-b3e6-d5c827187e55_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/86/cf869c0a80ea1ec24c2855145e87e960/pa/JP71821_1f889619a7c18cf4907ea927700e9511.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP71821%27 HTTP/1.1" 200 None
2026-03-28 19:11:26 [auto1.nl] INFO: Saving data for JP71821: {'created_time': 1774725086.954978, 'last_price_update_time': 1774725086.954988, 'auction_closing_time': 1774884871.0}
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JP71821') HTTP/1.1" 204 0
2026-03-28 19:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_5a4bbed1c274b163d81eb9d444b758ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_d26fefd21377bf7363df5e49e594dcef.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_d26fefd21377bf7363df5e49e594dcef.jpg not downloaded yet
2026-03-28 19:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84a6fd0>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F38%252F983806bcadc319b7d93e17a67295df6b%252Fpa%252FDH69810_7c1c5a9872bb72556110295784a8fb9c.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_7c1c5a9872bb72556110295784a8fb9c.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd
2026-03-28 19:11:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd, skipping ID generation
2026-03-28 19:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with scrape type 1
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd sending to next pipeline
2026-03-28 19:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd, identifier: DH69810
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82af850>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_82fed6f3ab08b3dfb14a597e79211456.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_82fed6f3ab08b3dfb14a597e79211456.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8716e10>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_2490df24fc5a95922caf304ffdc96c6c.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_2490df24fc5a95922caf304ffdc96c6c.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e873b010>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_9a8d58d0fb5047be78f47d860610da4a.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_9a8d58d0fb5047be78f47d860610da4a.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8634350>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_1dbf50aeead369a94cb49fd33ac50e29.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_1dbf50aeead369a94cb49fd33ac50e29.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_3ffc9025cdd7ac0098957b22c91de5f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_97d40ab4fad62d356b99f82cddadd113.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_747c792a6f5fdb5953211834e63cd804.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810
2026-03-28 19:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810
2026-03-28 19:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810 to the API
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_7c1c5a9872bb72556110295784a8fb9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:56Z',
 'fuel_type': 'petrol',
 'id': 'e36e2a2d-cb1a-5074-8b9b-2c76a91593cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'S657XV',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH69810',
 'listing': 'auction',
 'location': 'NL, Enschede',
 'make': 'BMW',
 'model': '1er',
 'odometer': 117453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_fff87bbccf2de5ac94087e7f5db2d7fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_347048fb289119df4a4c7de0142793ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_65134b89d824493ba6b1596de5958ca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_8081ab96d37a0ea348287f731d9ae3c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787017,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_ad533d56349e5b359be6648c6ae49b3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_d5f5d02fc57f05f7faec16e5c46492f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_a8efde430678c5258c1b641f2a748bda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2510117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_7c1c5a9872bb72556110295784a8fb9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_f8f1777c3aaa03e7bcebaf31d215a9ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36e2a2d-cb1a-5074-8b9b-2c76a91593cd/e36e2a2d-cb1a-5074-8b9b-2c76a91593cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/38/983806bcadc319b7d93e17a67295df6b/pa/DH69810_3e7cf3c4e43303f62fcef16c670201f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH69810%27 HTTP/1.1" 200 None
2026-03-28 19:11:27 [auto1.nl] INFO: Saving data for DH69810: {'created_time': 1774725087.768553, 'last_price_update_time': 1774725087.768565, 'auction_closing_time': 1774883276.0}
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DH69810') HTTP/1.1" 204 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_dd596556667ac6697a3bd5f822c134dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_dd596556667ac6697a3bd5f822c134dd.jpg not downloaded yet
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8394650>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_144cd090b8313184c3740d6772c63e30.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_144cd090b8313184c3740d6772c63e30.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_9033833bf3e62bdf2fc56db32f09eb54.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_7653d19fe6ddc9a3202b335b26f8db0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84a5390>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_5a4bbed1c274b163d81eb9d444b758ab.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_5a4bbed1c274b163d81eb9d444b758ab.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83d2bd0>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_3ffc9025cdd7ac0098957b22c91de5f1.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_3ffc9025cdd7ac0098957b22c91de5f1.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8357890>
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F75%252F9575bf37f506f56b862c7f80e9a3c5f9%252Fpa%252FJW17706_97d40ab4fad62d356b99f82cddadd113.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_97d40ab4fad62d356b99f82cddadd113.jpg saved to cache
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8
2026-03-28 19:11:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8, skipping ID generation
2026-03-28 19:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with scrape type 1
2026-03-28 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 sending to next pipeline
2026-03-28 19:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8, identifier: JW17706
2026-03-28 19:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84cba90>
2026-03-28 19:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F88%252F048837d6b441fbcea10c6ea662ae133a%252Fpa%252FPR08670_747c792a6f5fdb5953211834e63cd804.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_747c792a6f5fdb5953211834e63cd804.jpg saved to cache
2026-03-28 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfacca18-57fe-552a-b2ec-4360fc335b25
2026-03-28 19:11:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfacca18-57fe-552a-b2ec-4360fc335b25, skipping ID generation
2026-03-28 19:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfacca18-57fe-552a-b2ec-4360fc335b25 with scrape type 1
2026-03-28 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfacca18-57fe-552a-b2ec-4360fc335b25 sending to next pipeline
2026-03-28 19:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bfacca18-57fe-552a-b2ec-4360fc335b25, identifier: PR08670
2026-03-28 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706
2026-03-28 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706
2026-03-28 19:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706 to the API
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_97d40ab4fad62d356b99f82cddadd113.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'petrol',
 'id': '6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L617TB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW17706',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 179660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_97d40ab4fad62d356b99f82cddadd113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_268868d71d096e3503ce17643a542016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_82fed6f3ab08b3dfb14a597e79211456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_c27fece16a185ed2a439c8aa36e48c25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8/6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/75/9575bf37f506f56b862c7f80e9a3c5f9/pa/JW17706_e49214b0968339d810b4a9a7327fc28d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style',
 'transmission': 'manual',
 'trim': 'Sport & Style',
 'year': 2009}
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW17706%27 HTTP/1.1" 200 None
2026-03-28 19:11:28 [auto1.nl] INFO: Saving data for JW17706: {'created_time': 1774725088.554603, 'last_price_update_time': 1774725088.554646, 'auction_closing_time': 1774886222.0}
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW17706') HTTP/1.1" 204 0
2026-03-28 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670
2026-03-28 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670
2026-03-28 19:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670 to the API
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_747c792a6f5fdb5953211834e63cd804.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:48:28Z',
 'fuel_type': 'diesel',
 'id': 'bfacca18-57fe-552a-b2ec-4360fc335b25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JD025J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR08670',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'BMW',
 'model': '3er',
 'odometer': 222544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_3ffc9025cdd7ac0098957b22c91de5f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_747c792a6f5fdb5953211834e63cd804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_144cd090b8313184c3740d6772c63e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_1dbf50aeead369a94cb49fd33ac50e29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_9a8d58d0fb5047be78f47d860610da4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_0278c335367e4c061f10479d395348cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_497b985ff9b7b368398593ffd95b4e92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_6a84c1bfd826e28fac1f16b9fc7764dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_8ed92f30f059c26566edcebf040717e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfacca18-57fe-552a-b2ec-4360fc335b25/bfacca18-57fe-552a-b2ec-4360fc335b25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/88/048837d6b441fbcea10c6ea662ae133a/pa/PR08670_d3ff9579a966f923a2f5410ee64db7b9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Advantage',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Advantage',
 'year': 2016}
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR08670%27 HTTP/1.1" 200 None
2026-03-28 19:11:28 [auto1.nl] INFO: Saving data for PR08670: {'created_time': 1774725088.982398, 'last_price_update_time': 1774725088.982413, 'auction_closing_time': 1774885708.0}
2026-03-28 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PR08670') HTTP/1.1" 204 0
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_07db97671875c5361931a5a16a2e2e6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_d26fefd21377bf7363df5e49e594dcef.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e864e610>
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_9033833bf3e62bdf2fc56db32f09eb54.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_9033833bf3e62bdf2fc56db32f09eb54.jpg saved to cache
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d2ca630-420e-5a93-8498-d64476322ff4
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8635390>
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_7653d19fe6ddc9a3202b335b26f8db0e.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_7653d19fe6ddc9a3202b335b26f8db0e.jpg saved to cache
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d2ca630-420e-5a93-8498-d64476322ff4
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_dd596556667ac6697a3bd5f822c134dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84c3cd0>
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_07db97671875c5361931a5a16a2e2e6c.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_07db97671875c5361931a5a16a2e2e6c.jpg saved to cache
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d2ca630-420e-5a93-8498-d64476322ff4
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8300190>
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_d26fefd21377bf7363df5e49e594dcef.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_d26fefd21377bf7363df5e49e594dcef.jpg saved to cache
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d2ca630-420e-5a93-8498-d64476322ff4
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85a61d0>
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F533103b4bf4c6ce4457fc354c2abaf95%252Fpa%252FMD18286_dd596556667ac6697a3bd5f822c134dd.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_dd596556667ac6697a3bd5f822c134dd.jpg saved to cache
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d2ca630-420e-5a93-8498-d64476322ff4
2026-03-28 19:11:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d2ca630-420e-5a93-8498-d64476322ff4, skipping ID generation
2026-03-28 19:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2ca630-420e-5a93-8498-d64476322ff4 with scrape type 1
2026-03-28 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d2ca630-420e-5a93-8498-d64476322ff4 sending to next pipeline
2026-03-28 19:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6d2ca630-420e-5a93-8498-d64476322ff4, identifier: MD18286
2026-03-28 19:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286
2026-03-28 19:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286
2026-03-28 19:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286 to the API
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_dd596556667ac6697a3bd5f822c134dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:26Z',
 'fuel_type': 'petrol',
 'id': '6d2ca630-420e-5a93-8498-d64476322ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NX141D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD18286',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 112292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_7653d19fe6ddc9a3202b335b26f8db0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_9033833bf3e62bdf2fc56db32f09eb54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_07db97671875c5361931a5a16a2e2e6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_d26fefd21377bf7363df5e49e594dcef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2ca630-420e-5a93-8498-d64476322ff4/6d2ca630-420e-5a93-8498-d64476322ff4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/533103b4bf4c6ce4457fc354c2abaf95/pa/MD18286_dd596556667ac6697a3bd5f822c134dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18286%27 HTTP/1.1" 200 None
2026-03-28 19:11:29 [auto1.nl] INFO: Saving data for MD18286: {'created_time': 1774725089.709973, 'last_price_update_time': 1774725089.709985, 'auction_closing_time': 1774886246.0}
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD18286') HTTP/1.1" 204 0
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC15859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR27425/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f6adc394d4ae34979da200a24c11ac91.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_aeebadbf1f9a6e2b659df32225395830.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_66ed48b8ef3faeba07cd1c6405b9ad48.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU81834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR36555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME79677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ76461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:29 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 646 | hits on page: 40
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-28 19:11:29 [auto1.nl] INFO: Scrape type for XM87869: 0
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-28 19:11:29 [auto1.nl] INFO: Scrape type for FB82909: 0
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-28 19:11:29 [auto1.nl] INFO: Scrape type for YX65431: 0
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-28 19:11:29 [auto1.nl] INFO: Scrape type for MZ74119: 0
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-28 19:11:29 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for GW58352: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for JB09830: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for CY78777: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for DL13637: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for CD19489: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for RY80321: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for KC04488: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for SK13348: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for JB39700: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for NZ86515: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for WK03460: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for FG02230: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for NX59327: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for AB36156: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for JW97628: 0
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-28 19:11:30 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-28 19:11:30 [auto1.nl] INFO: Scrape type for LR40141: 0
2026-03-28 19:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea503fd0>
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_f6adc394d4ae34979da200a24c11ac91.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f6adc394d4ae34979da200a24c11ac91.jpg saved to cache
2026-03-28 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85ea210>
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_aeebadbf1f9a6e2b659df32225395830.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_aeebadbf1f9a6e2b659df32225395830.jpg saved to cache
2026-03-28 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8773410>
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0d%252F0b0d9719233de8bccd9586c77aa43f9f%252Fpa%252FDB68589_66ed48b8ef3faeba07cd1c6405b9ad48.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_66ed48b8ef3faeba07cd1c6405b9ad48.jpg saved to cache
2026-03-28 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32
2026-03-28 19:11:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32, skipping ID generation
2026-03-28 19:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with scrape type 1
2026-03-28 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 sending to next pipeline
2026-03-28 19:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32, identifier: DB68589
2026-03-28 19:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589
2026-03-28 19:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589
2026-03-28 19:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589 to the API
2026-03-28 19:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_66ed48b8ef3faeba07cd1c6405b9ad48.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:45:59Z',
 'fuel_type': 'diesel',
 'id': '36bdc8ce-b6db-55a0-867f-6f5eefb6ae32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '76TJP8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB68589',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 258098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_5a4bbed1c274b163d81eb9d444b758ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2268700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_66ed48b8ef3faeba07cd1c6405b9ad48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2262837,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_aeebadbf1f9a6e2b659df32225395830.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_2490df24fc5a95922caf304ffdc96c6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2257947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f6adc394d4ae34979da200a24c11ac91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_9424133fb5870cbba378be66daf4b8b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_a1b5761000d70fe3c52be11e54ffa4dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_f2f93a5e96da022e971cbc8149b8f133.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2312332,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_4915b07b7ff9ddbc565979c2cf97e14f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bdc8ce-b6db-55a0-867f-6f5eefb6ae32/36bdc8ce-b6db-55a0-867f-6f5eefb6ae32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0d/0b0d9719233de8bccd9586c77aa43f9f/pa/DB68589_cbf8d3c5e1437b2afe1c2e186c329322.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB68589%27 HTTP/1.1" 200 None
2026-03-28 19:11:31 [auto1.nl] INFO: Saving data for DB68589: {'created_time': 1774725091.455606, 'last_price_update_time': 1774725091.455619, 'auction_closing_time': 1774885559.0}
2026-03-28 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB68589') HTTP/1.1" 204 0
2026-03-28 19:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT04530/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME79677> (referer: https://www.auto1.com/v1/car-details-view/ME79677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677
2026-03-28 19:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9239e5-1b78-5fab-b285-e59375f27b28 with scrape type 1
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 7c9239e5-1b78-5fab-b285-e59375f27b28
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F58%252Fad5856ca2f227e71d22007681149ce91%252Fpa%252FME79677_966116624bf3286ddb2c0c0bfa22d1e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_966116624bf3286ddb2c0c0bfa22d1e2.jpg already downloaded
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F58%252Fad5856ca2f227e71d22007681149ce91%252Fpa%252FME79677_6324011e20cb36d190393cc329156fbc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_6324011e20cb36d190393cc329156fbc.jpg already downloaded
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F58%252Fad5856ca2f227e71d22007681149ce91%252Fpa%252FME79677_dd192c17ef1db41d373e64ec677604d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_dd192c17ef1db41d373e64ec677604d4.jpg already downloaded
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F58%252Fad5856ca2f227e71d22007681149ce91%252Fpa%252FME79677_65adf1036aee50bac648ef14fcf04786.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_65adf1036aee50bac648ef14fcf04786.jpg already downloaded
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F58%252Fad5856ca2f227e71d22007681149ce91%252Fpa%252FME79677_93cf499733d2f364303d29893cb32e44.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_93cf499733d2f364303d29893cb32e44.jpg already downloaded
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F58%252Fad5856ca2f227e71d22007681149ce91%252Fpa%252FME79677_51a417351ceafd3a5ed30637e1759a45.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_51a417351ceafd3a5ed30637e1759a45.jpg already downloaded
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F58%252Fad5856ca2f227e71d22007681149ce91%252Fpa%252FME79677_84ad8ef667cb578abfe70ccbf861e076.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_84ad8ef667cb578abfe70ccbf861e076.jpg already downloaded
2026-03-28 19:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c9239e5-1b78-5fab-b285-e59375f27b28, identifier: ME79677
2026-03-28 19:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677
2026-03-28 19:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677
2026-03-28 19:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677 to the API
2026-03-28 19:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME79677>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:12:09Z',
 'fuel_type': 'diesel',
 'id': '7c9239e5-1b78-5fab-b285-e59375f27b28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HF995T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME79677',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 101066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photo_urls': ['https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_966116624bf3286ddb2c0c0bfa22d1e2.jpg',
                'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_6324011e20cb36d190393cc329156fbc.jpg',
                'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_dd192c17ef1db41d373e64ec677604d4.jpg',
                'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_65adf1036aee50bac648ef14fcf04786.jpg',
                'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_93cf499733d2f364303d29893cb32e44.jpg',
                'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_51a417351ceafd3a5ed30637e1759a45.jpg',
                'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_84ad8ef667cb578abfe70ccbf861e076.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9239e5-1b78-5fab-b285-e59375f27b28/7c9239e5-1b78-5fab-b285-e59375f27b28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41283,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_966116624bf3286ddb2c0c0bfa22d1e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9239e5-1b78-5fab-b285-e59375f27b28/7c9239e5-1b78-5fab-b285-e59375f27b28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39963,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_6324011e20cb36d190393cc329156fbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9239e5-1b78-5fab-b285-e59375f27b28/7c9239e5-1b78-5fab-b285-e59375f27b28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302258,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_dd192c17ef1db41d373e64ec677604d4.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9239e5-1b78-5fab-b285-e59375f27b28/7c9239e5-1b78-5fab-b285-e59375f27b28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332196,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_65adf1036aee50bac648ef14fcf04786.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9239e5-1b78-5fab-b285-e59375f27b28/7c9239e5-1b78-5fab-b285-e59375f27b28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52168,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_93cf499733d2f364303d29893cb32e44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9239e5-1b78-5fab-b285-e59375f27b28/7c9239e5-1b78-5fab-b285-e59375f27b28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386303,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_51a417351ceafd3a5ed30637e1759a45.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9239e5-1b78-5fab-b285-e59375f27b28/7c9239e5-1b78-5fab-b285-e59375f27b28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297372,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/58/ad5856ca2f227e71d22007681149ce91/pa/ME79677_84ad8ef667cb578abfe70ccbf861e076.jpg',
             'Width': 1920}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [auto1.nl] INFO: Saving data for ME79677: {'created_time': 1774725093.170464, 'last_price_update_time': 1774725093.170476, 'auction_closing_time': 1774883529.0}
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME79677') HTTP/1.1" 204 0
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU81834> (referer: https://www.auto1.com/v1/car-details-view/GU81834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR36555> (referer: https://www.auto1.com/v1/car-details-view/DR36555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ76461> (referer: https://www.auto1.com/v1/car-details-view/RZ76461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR27425> (referer: https://www.auto1.com/v1/car-details-view/XR27425/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC15859> (referer: https://www.auto1.com/v1/car-details-view/BC15859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:33 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 646 | hits on page: 6
2026-03-28 19:11:33 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-28 19:11:33 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [auto1.nl] INFO: Scrape type for EP93197: 0
2026-03-28 19:11:33 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [auto1.nl] INFO: Scrape type for DT42929: 0
2026-03-28 19:11:33 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-28 19:11:33 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [auto1.nl] INFO: Scrape type for AV73218: 0
2026-03-28 19:11:33 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-28 19:11:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT04530> (referer: https://www.auto1.com/v1/car-details-view/PT04530/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834
2026-03-28 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with scrape type 1
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_7b919f41c8aeb7f17ef22dd7889ca77d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_7b919f41c8aeb7f17ef22dd7889ca77d.jpg not downloaded yet
2026-03-28 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555
2026-03-28 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with scrape type 1
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_cd47810671387f251d7dc1f393ad4ea9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_cd47810671387f251d7dc1f393ad4ea9.jpg not downloaded yet
2026-03-28 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98502506-01b6-5e0f-b814-7e53e3e814e6 with identifier: RZ76461
2026-03-28 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98502506-01b6-5e0f-b814-7e53e3e814e6 with scrape type 1
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_4d27efd3e5f8c58f6e457c0cf599b830.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_4d27efd3e5f8c58f6e457c0cf599b830.jpg not downloaded yet
2026-03-28 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425
2026-03-28 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3bbac99-6b47-5e01-a757-fc39521f32e1 with scrape type 1
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c3bbac99-6b47-5e01-a757-fc39521f32e1
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_26f0387adc30a90d17a7054791b33174.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_26f0387adc30a90d17a7054791b33174.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_e3117c9ea50ffd25a210f87041e3dc24.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e3117c9ea50ffd25a210f87041e3dc24.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_f0e61f2896ca5257ae6e935e2eb74a81.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f0e61f2896ca5257ae6e935e2eb74a81.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_95788fbda7a957d78e994a8d71112f16.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_95788fbda7a957d78e994a8d71112f16.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_29465d1708a2c4452e579ccedc175237.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_29465d1708a2c4452e579ccedc175237.jpg not downloaded yet
2026-03-28 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859
2026-03-28 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f with scrape type 1
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_fa212f2c0d715e9411a24bdea31ebe1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_fa212f2c0d715e9411a24bdea31ebe1f.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_6fa357ed186d05d8993f3df2f19068c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6fa357ed186d05d8993f3df2f19068c6.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_d949bcdf57218108dc585ff9073139dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_d949bcdf57218108dc585ff9073139dc.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_1989397442c3af31bdbc0ff3705b9b16.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_1989397442c3af31bdbc0ff3705b9b16.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_0120fb43af96cb00730cd0817646b2af.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_0120fb43af96cb00730cd0817646b2af.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_f4432d3a3098600cd10cad41ed12ae9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_f4432d3a3098600cd10cad41ed12ae9d.jpg not downloaded yet
2026-03-28 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530
2026-03-28 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3190eb8d-0462-54fb-917c-2ba1550b9699 with scrape type 1
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_6b68891f4d6ddf0e90b6e8700040c523.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_6b68891f4d6ddf0e90b6e8700040c523.jpg not downloaded yet
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_4d27efd3e5f8c58f6e457c0cf599b830.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_5f4527eea7ec9ba0196aed029732bea0.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_5f4527eea7ec9ba0196aed029732bea0.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_a7df391fdd231ead1528f2e16fbdc436.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_a7df391fdd231ead1528f2e16fbdc436.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_3ba69a334cad8d1dedeb4bedd01cf8f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3ba69a334cad8d1dedeb4bedd01cf8f7.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_4e134ad744812257753c78b7ae393167.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_4e134ad744812257753c78b7ae393167.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_87af7c0c8b62e19701397c63c38ebcf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_87af7c0c8b62e19701397c63c38ebcf3.jpg not downloaded yet
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_cd47810671387f251d7dc1f393ad4ea9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_7b919f41c8aeb7f17ef22dd7889ca77d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_26f0387adc30a90d17a7054791b33174.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_04569aecb5f26477293bfd37eb47a0b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_04569aecb5f26477293bfd37eb47a0b8.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_f0290d32d7e3205c48d1dc54823c416f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0290d32d7e3205c48d1dc54823c416f.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_89f25705c1adbb741823c3791edaff85.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_89f25705c1adbb741823c3791edaff85.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_627d5f3fc161959b8b7f20e2aaa530d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_627d5f3fc161959b8b7f20e2aaa530d9.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_bfdef95da4207beae0aa2335db7077bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_bfdef95da4207beae0aa2335db7077bd.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_6a449a2fe024c1754e4791c809ae9d19.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6a449a2fe024c1754e4791c809ae9d19.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_f62dea9536857560ce3d00c1a1ab0215.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_f62dea9536857560ce3d00c1a1ab0215.jpg not downloaded yet
2026-03-28 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e3117c9ea50ffd25a210f87041e3dc24.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_f0a0fc024c76c936aab8f523160c446a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0a0fc024c76c936aab8f523160c446a.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_f7e7bf541c32b6928e7fff128b711c47.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f7e7bf541c32b6928e7fff128b711c47.jpg not downloaded yet
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_dec3a7197eeb734a76fae2b990c62186.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_dec3a7197eeb734a76fae2b990c62186.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_03e8236f26cbead3b3e35ac45fac11ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_03e8236f26cbead3b3e35ac45fac11ef.jpg not downloaded yet
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea7fb7d0>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_4d27efd3e5f8c58f6e457c0cf599b830.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_4d27efd3e5f8c58f6e457c0cf599b830.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_29465d1708a2c4452e579ccedc175237.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_fa212f2c0d715e9411a24bdea31ebe1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_60772f2d699a99aa1efe6f2e69db0dd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_60772f2d699a99aa1efe6f2e69db0dd6.jpg not downloaded yet
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_0120fb43af96cb00730cd0817646b2af.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_0a3b3e03fa0085cc63025d30e2dab571.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_0a3b3e03fa0085cc63025d30e2dab571.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_b64e6ef95b4c2cd8fb65e1358fd007c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_b64e6ef95b4c2cd8fb65e1358fd007c7.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_5f84aa60fdf210845f5a36fac59d243f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_5f84aa60fdf210845f5a36fac59d243f.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_6f49523e2a17d265562cd53cdb06d94f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6f49523e2a17d265562cd53cdb06d94f.jpg not downloaded yet
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e829c190>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_cd47810671387f251d7dc1f393ad4ea9.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_cd47810671387f251d7dc1f393ad4ea9.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85a6bd0>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_7b919f41c8aeb7f17ef22dd7889ca77d.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_7b919f41c8aeb7f17ef22dd7889ca77d.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e05d0>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_26f0387adc30a90d17a7054791b33174.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_26f0387adc30a90d17a7054791b33174.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3bbac99-6b47-5e01-a757-fc39521f32e1
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_f4432d3a3098600cd10cad41ed12ae9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_b64047186ce31e2862685eee40b287ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_b64047186ce31e2862685eee40b287ac.jpg not downloaded yet
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_d949bcdf57218108dc585ff9073139dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_1989397442c3af31bdbc0ff3705b9b16.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_6648857f8cc21fb747effd45689f32b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6648857f8cc21fb747effd45689f32b9.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_31fa747a29866dee9620deb7eac58b6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_31fa747a29866dee9620deb7eac58b6b.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_612ac37fa7f4bf2803e908d1cdb95696.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_612ac37fa7f4bf2803e908d1cdb95696.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_11e1e175832ece7fe754e2c875db054f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_11e1e175832ece7fe754e2c875db054f.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_53090698ce2566a63c8ce91ccddab7b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_53090698ce2566a63c8ce91ccddab7b1.jpg not downloaded yet
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85a4090>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_e3117c9ea50ffd25a210f87041e3dc24.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e3117c9ea50ffd25a210f87041e3dc24.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e836dbd0>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_29465d1708a2c4452e579ccedc175237.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_29465d1708a2c4452e579ccedc175237.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3bbac99-6b47-5e01-a757-fc39521f32e1
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e863d710>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_fa212f2c0d715e9411a24bdea31ebe1f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_fa212f2c0d715e9411a24bdea31ebe1f.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e866aa10>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_0120fb43af96cb00730cd0817646b2af.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_0120fb43af96cb00730cd0817646b2af.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3bbac99-6b47-5e01-a757-fc39521f32e1
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_1ec7c5d46eb8823039126ff04d4fd893.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_1ec7c5d46eb8823039126ff04d4fd893.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_14276e5072899641fd07f6f4e84e61d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_14276e5072899641fd07f6f4e84e61d7.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_abd91a19e817081f7add7f5f280add2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_abd91a19e817081f7add7f5f280add2b.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_8ab388ff68e88a5ffb86c2d2bc69c2f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_8ab388ff68e88a5ffb86c2d2bc69c2f8.jpg not downloaded yet
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3ba69a334cad8d1dedeb4bedd01cf8f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_87af7c0c8b62e19701397c63c38ebcf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_4e134ad744812257753c78b7ae393167.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_4900c79423f8727a3f6a5eedbe25e1ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_4900c79423f8727a3f6a5eedbe25e1ee.jpg not downloaded yet
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_e62b473b1dd5e0f5d71a1b847a41826a.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e62b473b1dd5e0f5d71a1b847a41826a.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_76615c13adb373f09329cd912e801ac8.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_76615c13adb373f09329cd912e801ac8.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_3321a89f1f132b488a39f6c920eaddd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3321a89f1f132b488a39f6c920eaddd2.jpg not downloaded yet
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_358484f5704ad212f66b6f69fad26a0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_358484f5704ad212f66b6f69fad26a0f.jpg not downloaded yet
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82c6f90>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_f4432d3a3098600cd10cad41ed12ae9d.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_f4432d3a3098600cd10cad41ed12ae9d.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e81c8190>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_d949bcdf57218108dc585ff9073139dc.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_d949bcdf57218108dc585ff9073139dc.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e81d73d0>
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_1989397442c3af31bdbc0ff3705b9b16.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_1989397442c3af31bdbc0ff3705b9b16.jpg saved to cache
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_a7df391fdd231ead1528f2e16fbdc436.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_e9f069506a3e3f04b207acf7792ea917.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_e9f069506a3e3f04b207acf7792ea917.jpg not downloaded yet
2026-03-28 19:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_5f4527eea7ec9ba0196aed029732bea0.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_b02672f6a1339be100693e17222907dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_b02672f6a1339be100693e17222907dd.jpg not downloaded yet
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_c76a63e98d6a4dfd97f008f53dbb6334.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_c76a63e98d6a4dfd97f008f53dbb6334.jpg not downloaded yet
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e81bdb90>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_3ba69a334cad8d1dedeb4bedd01cf8f7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3ba69a334cad8d1dedeb4bedd01cf8f7.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8665610>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_87af7c0c8b62e19701397c63c38ebcf3.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_87af7c0c8b62e19701397c63c38ebcf3.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84ce310>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_4e134ad744812257753c78b7ae393167.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_4e134ad744812257753c78b7ae393167.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3bbac99-6b47-5e01-a757-fc39521f32e1
2026-03-28 19:11:35 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 646 | hits on page: 0
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6a449a2fe024c1754e4791c809ae9d19.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_03e8236f26cbead3b3e35ac45fac11ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_8b8783ec0f9e7606f409ef74adfaa99e.jpg%27 HTTP/1.1" 200 None
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_8b8783ec0f9e7606f409ef74adfaa99e.jpg not downloaded yet
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f7e7bf541c32b6928e7fff128b711c47.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_dec3a7197eeb734a76fae2b990c62186.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84d0e50>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_a7df391fdd231ead1528f2e16fbdc436.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_a7df391fdd231ead1528f2e16fbdc436.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e819f950>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_5f4527eea7ec9ba0196aed029732bea0.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_5f4527eea7ec9ba0196aed029732bea0.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_60772f2d699a99aa1efe6f2e69db0dd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea8baf10>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_6a449a2fe024c1754e4791c809ae9d19.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6a449a2fe024c1754e4791c809ae9d19.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8421e90>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_03e8236f26cbead3b3e35ac45fac11ef.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_03e8236f26cbead3b3e35ac45fac11ef.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_14276e5072899641fd07f6f4e84e61d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_b64047186ce31e2862685eee40b287ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8465410>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_f7e7bf541c32b6928e7fff128b711c47.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f7e7bf541c32b6928e7fff128b711c47.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea4bf8d0>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_dec3a7197eeb734a76fae2b990c62186.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_dec3a7197eeb734a76fae2b990c62186.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6f49523e2a17d265562cd53cdb06d94f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_8ab388ff68e88a5ffb86c2d2bc69c2f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_abd91a19e817081f7add7f5f280add2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea510510>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_3.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_60772f2d699a99aa1efe6f2e69db0dd6.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_60772f2d699a99aa1efe6f2e69db0dd6.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84649d0>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_14276e5072899641fd07f6f4e84e61d7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_14276e5072899641fd07f6f4e84e61d7.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea4bdd10>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_b64047186ce31e2862685eee40b287ac.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_b64047186ce31e2862685eee40b287ac.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_c76a63e98d6a4dfd97f008f53dbb6334.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_e9f069506a3e3f04b207acf7792ea917.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e819c750>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_6f49523e2a17d265562cd53cdb06d94f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6f49523e2a17d265562cd53cdb06d94f.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e867d350>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_8ab388ff68e88a5ffb86c2d2bc69c2f8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_8ab388ff68e88a5ffb86c2d2bc69c2f8.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea56fdd0>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_abd91a19e817081f7add7f5f280add2b.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_abd91a19e817081f7add7f5f280add2b.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_1ec7c5d46eb8823039126ff04d4fd893.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_4900c79423f8727a3f6a5eedbe25e1ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_b02672f6a1339be100693e17222907dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8421190>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_c76a63e98d6a4dfd97f008f53dbb6334.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_c76a63e98d6a4dfd97f008f53dbb6334.jpg saved to cache
2026-03-28 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e832f3d0>
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_e9f069506a3e3f04b207acf7792ea917.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_e9f069506a3e3f04b207acf7792ea917.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_76615c13adb373f09329cd912e801ac8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_8b8783ec0f9e7606f409ef74adfaa99e.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_95788fbda7a957d78e994a8d71112f16.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e819ee50>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_1ec7c5d46eb8823039126ff04d4fd893.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_1ec7c5d46eb8823039126ff04d4fd893.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8656ad0>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_4900c79423f8727a3f6a5eedbe25e1ee.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_4900c79423f8727a3f6a5eedbe25e1ee.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83dbfd0>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_b02672f6a1339be100693e17222907dd.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_b02672f6a1339be100693e17222907dd.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6fa357ed186d05d8993f3df2f19068c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_358484f5704ad212f66b6f69fad26a0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f0e61f2896ca5257ae6e935e2eb74a81.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e62b473b1dd5e0f5d71a1b847a41826a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3321a89f1f132b488a39f6c920eaddd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_53090698ce2566a63c8ce91ccddab7b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84675d0>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_76615c13adb373f09329cd912e801ac8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_76615c13adb373f09329cd912e801ac8.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85e8d50>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_8b8783ec0f9e7606f409ef74adfaa99e.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_8b8783ec0f9e7606f409ef74adfaa99e.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82af750>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_95788fbda7a957d78e994a8d71112f16.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_95788fbda7a957d78e994a8d71112f16.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6648857f8cc21fb747effd45689f32b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0a0fc024c76c936aab8f523160c446a.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_11e1e175832ece7fe754e2c875db054f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_0a3b3e03fa0085cc63025d30e2dab571.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_b64e6ef95b4c2cd8fb65e1358fd007c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8744610>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_6fa357ed186d05d8993f3df2f19068c6.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6fa357ed186d05d8993f3df2f19068c6.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8388a10>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_358484f5704ad212f66b6f69fad26a0f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_358484f5704ad212f66b6f69fad26a0f.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e4450>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_f0e61f2896ca5257ae6e935e2eb74a81.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f0e61f2896ca5257ae6e935e2eb74a81.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e82d02d0>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_e62b473b1dd5e0f5d71a1b847a41826a.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e62b473b1dd5e0f5d71a1b847a41826a.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e7fd0>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_3321a89f1f132b488a39f6c920eaddd2.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3321a89f1f132b488a39f6c920eaddd2.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8357010>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_53090698ce2566a63c8ce91ccddab7b1.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_53090698ce2566a63c8ce91ccddab7b1.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_f62dea9536857560ce3d00c1a1ab0215.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_bfdef95da4207beae0aa2335db7077bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e83e7a10>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_6648857f8cc21fb747effd45689f32b9.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6648857f8cc21fb747effd45689f32b9.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea53e690>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_f0a0fc024c76c936aab8f523160c446a.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0a0fc024c76c936aab8f523160c446a.jpg saved to cache
2026-03-28 19:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e837ded0>
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Ff7%252F96f7fadfd960ef7276e367a73561ab09%252Fpa%252FBC15859_11e1e175832ece7fe754e2c875db054f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_11e1e175832ece7fe754e2c875db054f.jpg saved to cache
2026-03-28 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f
2026-03-28 19:11:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 893f96e0-d223-5919-a1fc-d8e1a1ca279f, skipping ID generation
2026-03-28 19:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f with scrape type 1
2026-03-28 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f sending to next pipeline
2026-03-28 19:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 893f96e0-d223-5919-a1fc-d8e1a1ca279f, identifier: BC15859
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8318350>
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_0a3b3e03fa0085cc63025d30e2dab571.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_0a3b3e03fa0085cc63025d30e2dab571.jpg saved to cache
2026-03-28 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e81baed0>
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_b64e6ef95b4c2cd8fb65e1358fd007c7.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_b64e6ef95b4c2cd8fb65e1358fd007c7.jpg saved to cache
2026-03-28 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859
2026-03-28 19:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859
2026-03-28 19:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859 to the API
2026-03-28 19:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_11e1e175832ece7fe754e2c875db054f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:28Z',
 'fuel_type': 'petrol',
 'id': '893f96e0-d223-5919-a1fc-d8e1a1ca279f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7ZBR94',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC15859',
 'listing': 'auction',
 'location': 'NL, Ede',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 135168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_fa212f2c0d715e9411a24bdea31ebe1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_f4432d3a3098600cd10cad41ed12ae9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_87af7c0c8b62e19701397c63c38ebcf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6a449a2fe024c1754e4791c809ae9d19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_03e8236f26cbead3b3e35ac45fac11ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_6f49523e2a17d265562cd53cdb06d94f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_11e1e175832ece7fe754e2c875db054f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_8ab388ff68e88a5ffb86c2d2bc69c2f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_358484f5704ad212f66b6f69fad26a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_893f96e0-d223-5919-a1fc-d8e1a1ca279f/893f96e0-d223-5919-a1fc-d8e1a1ca279f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/f7/96f7fadfd960ef7276e367a73561ab09/pa/BC15859_b02672f6a1339be100693e17222907dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2014}
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC15859%27 HTTP/1.1" 200 None
2026-03-28 19:11:39 [auto1.nl] INFO: Saving data for BC15859: {'created_time': 1774725099.879678, 'last_price_update_time': 1774725099.879689, 'auction_closing_time': 1774884268.0}
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC15859') HTTP/1.1" 204 0
2026-03-28 19:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_6b68891f4d6ddf0e90b6e8700040c523.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_04569aecb5f26477293bfd37eb47a0b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_89f25705c1adbb741823c3791edaff85.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0290d32d7e3205c48d1dc54823c416f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_627d5f3fc161959b8b7f20e2aaa530d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8465b90>
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_2.jpg HTTP/1.1" 201 0
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_f62dea9536857560ce3d00c1a1ab0215.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_f62dea9536857560ce3d00c1a1ab0215.jpg saved to cache
2026-03-28 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e840ecd0>
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F12%252F2f1201bb8cb95638e0c427e6b9851d4c%252Fpa%252FXR27425_bfdef95da4207beae0aa2335db7077bd.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_bfdef95da4207beae0aa2335db7077bd.jpg saved to cache
2026-03-28 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3bbac99-6b47-5e01-a757-fc39521f32e1
2026-03-28 19:11:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3bbac99-6b47-5e01-a757-fc39521f32e1, skipping ID generation
2026-03-28 19:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3bbac99-6b47-5e01-a757-fc39521f32e1 with scrape type 1
2026-03-28 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3bbac99-6b47-5e01-a757-fc39521f32e1 sending to next pipeline
2026-03-28 19:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c3bbac99-6b47-5e01-a757-fc39521f32e1, identifier: XR27425
2026-03-28 19:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425
2026-03-28 19:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425
2026-03-28 19:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425 to the API
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_bfdef95da4207beae0aa2335db7077bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:07:43Z',
 'fuel_type': 'petrol',
 'id': 'c3bbac99-6b47-5e01-a757-fc39521f32e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '73GSP5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR27425',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 100707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_26f0387adc30a90d17a7054791b33174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_29465d1708a2c4452e579ccedc175237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_0120fb43af96cb00730cd0817646b2af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_4e134ad744812257753c78b7ae393167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bbac99-6b47-5e01-a757-fc39521f32e1/c3bbac99-6b47-5e01-a757-fc39521f32e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/12/2f1201bb8cb95638e0c427e6b9851d4c/pa/XR27425_bfdef95da4207beae0aa2335db7077bd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR27425%27 HTTP/1.1" 200 None
2026-03-28 19:11:40 [auto1.nl] INFO: Saving data for XR27425: {'created_time': 1774725100.46207, 'last_price_update_time': 1774725100.462081, 'auction_closing_time': 1774883263.0}
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XR27425') HTTP/1.1" 204 0
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e84495d0>
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_0.jpg HTTP/1.1" 201 0
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_6b68891f4d6ddf0e90b6e8700040c523.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_6b68891f4d6ddf0e90b6e8700040c523.jpg saved to cache
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e81b42d0>
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_1.jpg HTTP/1.1" 201 0
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F79%252F78791cadc4f0fd05a16224838979fde1%252Fpa%252FPT04530_04569aecb5f26477293bfd37eb47a0b8.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_04569aecb5f26477293bfd37eb47a0b8.jpg saved to cache
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3190eb8d-0462-54fb-917c-2ba1550b9699
2026-03-28 19:11:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3190eb8d-0462-54fb-917c-2ba1550b9699, skipping ID generation
2026-03-28 19:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3190eb8d-0462-54fb-917c-2ba1550b9699 with scrape type 1
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3190eb8d-0462-54fb-917c-2ba1550b9699 sending to next pipeline
2026-03-28 19:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3190eb8d-0462-54fb-917c-2ba1550b9699, identifier: PT04530
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e8714d10>
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_89f25705c1adbb741823c3791edaff85.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_89f25705c1adbb741823c3791edaff85.jpg saved to cache
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e81b5990>
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F300511fc85a37a0fb9988bafbd3e35a9%252Fpa%252FGU81834_f0290d32d7e3205c48d1dc54823c416f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0290d32d7e3205c48d1dc54823c416f.jpg saved to cache
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6
2026-03-28 19:11:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6, skipping ID generation
2026-03-28 19:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with scrape type 1
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 sending to next pipeline
2026-03-28 19:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6, identifier: GU81834
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea7f2cd0>
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_627d5f3fc161959b8b7f20e2aaa530d9.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_627d5f3fc161959b8b7f20e2aaa530d9.jpg saved to cache
2026-03-28 19:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530
2026-03-28 19:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530
2026-03-28 19:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530 to the API
2026-03-28 19:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_04569aecb5f26477293bfd37eb47a0b8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:03Z',
 'fuel_type': 'diesel',
 'id': '3190eb8d-0462-54fb-917c-2ba1550b9699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'V081PS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT04530',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 139378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_6b68891f4d6ddf0e90b6e8700040c523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_04569aecb5f26477293bfd37eb47a0b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_f62dea9536857560ce3d00c1a1ab0215.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_60772f2d699a99aa1efe6f2e69db0dd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_b64047186ce31e2862685eee40b287ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_53090698ce2566a63c8ce91ccddab7b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_4900c79423f8727a3f6a5eedbe25e1ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_e9f069506a3e3f04b207acf7792ea917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_c76a63e98d6a4dfd97f008f53dbb6334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3190eb8d-0462-54fb-917c-2ba1550b9699/3190eb8d-0462-54fb-917c-2ba1550b9699_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/79/78791cadc4f0fd05a16224838979fde1/pa/PT04530_8b8783ec0f9e7606f409ef74adfaa99e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L2 Premium',
 'transmission': 'manual',
 'trim': 'L2 Premium',
 'year': 2018}
2026-03-28 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT04530%27 HTTP/1.1" 200 None
2026-03-28 19:11:41 [auto1.nl] INFO: Saving data for PT04530: {'created_time': 1774725101.904705, 'last_price_update_time': 1774725101.904716, 'auction_closing_time': 1774883463.0}
2026-03-28 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT04530') HTTP/1.1" 204 0
2026-03-28 19:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834
2026-03-28 19:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834
2026-03-28 19:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834 to the API
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0290d32d7e3205c48d1dc54823c416f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:12:00Z',
 'fuel_type': 'petrol',
 'id': 'af8b3a3e-7397-5cdf-9e29-57f390a8ccb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '17XPXF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU81834',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 150140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_7b919f41c8aeb7f17ef22dd7889ca77d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e3117c9ea50ffd25a210f87041e3dc24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2140166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6fa357ed186d05d8993f3df2f19068c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_5f4527eea7ec9ba0196aed029732bea0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0290d32d7e3205c48d1dc54823c416f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_f0a0fc024c76c936aab8f523160c446a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_0a3b3e03fa0085cc63025d30e2dab571.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_6648857f8cc21fb747effd45689f32b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_1ec7c5d46eb8823039126ff04d4fd893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b3a3e-7397-5cdf-9e29-57f390a8ccb6/af8b3a3e-7397-5cdf-9e29-57f390a8ccb6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/300511fc85a37a0fb9988bafbd3e35a9/pa/GU81834_e62b473b1dd5e0f5d71a1b847a41826a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2007}
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU81834%27 HTTP/1.1" 200 None
2026-03-28 19:11:42 [auto1.nl] INFO: Saving data for GU81834: {'created_time': 1774725102.289778, 'last_price_update_time': 1774725102.289789, 'auction_closing_time': 1774883520.0}
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GU81834') HTTP/1.1" 204 0
2026-03-28 19:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_612ac37fa7f4bf2803e908d1cdb95696.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_31fa747a29866dee9620deb7eac58b6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_5f84aa60fdf210845f5a36fac59d243f.jpg> (referer: https://www.auto1.com/)
2026-03-28 19:11:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e829c090>
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_612ac37fa7f4bf2803e908d1cdb95696.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_612ac37fa7f4bf2803e908d1cdb95696.jpg saved to cache
2026-03-28 19:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6e85fda90>
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_7.jpg HTTP/1.1" 201 0
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a2864447525735d9df403991f46372c%252Fpa%252FDR36555_31fa747a29866dee9620deb7eac58b6b.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_31fa747a29866dee9620deb7eac58b6b.jpg saved to cache
2026-03-28 19:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684
2026-03-28 19:11:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10d8dbde-ff44-5459-855c-f7e8e8c1f684, skipping ID generation
2026-03-28 19:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with scrape type 1
2026-03-28 19:11:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684 sending to next pipeline
2026-03-28 19:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 10d8dbde-ff44-5459-855c-f7e8e8c1f684, identifier: DR36555
2026-03-28 19:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555
2026-03-28 19:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555
2026-03-28 19:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555 to the API
2026-03-28 19:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_31fa747a29866dee9620deb7eac58b6b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:21Z',
 'fuel_type': 'petrol',
 'id': '10d8dbde-ff44-5459-855c-f7e8e8c1f684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XB-945-L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR36555',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 113201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_cd47810671387f251d7dc1f393ad4ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557423,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f0e61f2896ca5257ae6e935e2eb74a81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_d949bcdf57218108dc585ff9073139dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_a7df391fdd231ead1528f2e16fbdc436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_89f25705c1adbb741823c3791edaff85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_f7e7bf541c32b6928e7fff128b711c47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_b64e6ef95b4c2cd8fb65e1358fd007c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_31fa747a29866dee9620deb7eac58b6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_14276e5072899641fd07f6f4e84e61d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10d8dbde-ff44-5459-855c-f7e8e8c1f684/10d8dbde-ff44-5459-855c-f7e8e8c1f684_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a2864447525735d9df403991f46372c/pa/DR36555_76615c13adb373f09329cd912e801ac8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Beats BlueMotion',
 'transmission': 'manual',
 'trim': 'Beats BlueMotion',
 'year': 2017}
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR36555%27 HTTP/1.1" 200 None
2026-03-28 19:11:43 [auto1.nl] INFO: Saving data for DR36555: {'created_time': 1774725103.118411, 'last_price_update_time': 1774725103.11842, 'auction_closing_time': 1774883301.0}
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR36555') HTTP/1.1" 204 0
2026-03-28 19:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 19:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 19:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd6ea9d6210>
2026-03-28 19:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 19:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fad%252F17ad62d774ef1b3800e3ecd7d6862b3f%252Fpa%252FRZ76461_5f84aa60fdf210845f5a36fac59d243f.jpg') HTTP/1.1" 204 0
2026-03-28 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_5f84aa60fdf210845f5a36fac59d243f.jpg saved to cache
2026-03-28 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98502506-01b6-5e0f-b814-7e53e3e814e6
2026-03-28 19:11:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98502506-01b6-5e0f-b814-7e53e3e814e6, skipping ID generation
2026-03-28 19:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98502506-01b6-5e0f-b814-7e53e3e814e6 with scrape type 1
2026-03-28 19:11:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98502506-01b6-5e0f-b814-7e53e3e814e6 sending to next pipeline
2026-03-28 19:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 98502506-01b6-5e0f-b814-7e53e3e814e6, identifier: RZ76461
2026-03-28 19:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 98502506-01b6-5e0f-b814-7e53e3e814e6 with identifier: RZ76461
2026-03-28 19:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 98502506-01b6-5e0f-b814-7e53e3e814e6 with identifier: RZ76461
2026-03-28 19:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 98502506-01b6-5e0f-b814-7e53e3e814e6 with identifier: RZ76461 to the API
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 19:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_5f84aa60fdf210845f5a36fac59d243f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:12:46Z',
 'fuel_type': 'petrol',
 'id': '98502506-01b6-5e0f-b814-7e53e3e814e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'J232GK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ76461',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 101294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_4d27efd3e5f8c58f6e457c0cf599b830.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_95788fbda7a957d78e994a8d71112f16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_1989397442c3af31bdbc0ff3705b9b16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3ba69a334cad8d1dedeb4bedd01cf8f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_627d5f3fc161959b8b7f20e2aaa530d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_dec3a7197eeb734a76fae2b990c62186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_5f84aa60fdf210845f5a36fac59d243f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_612ac37fa7f4bf2803e908d1cdb95696.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_abd91a19e817081f7add7f5f280add2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98502506-01b6-5e0f-b814-7e53e3e814e6/98502506-01b6-5e0f-b814-7e53e3e814e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/ad/17ad62d774ef1b3800e3ecd7d6862b3f/pa/RZ76461_3321a89f1f132b488a39f6c920eaddd2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RZ76461%27 HTTP/1.1" 200 None
2026-03-28 19:11:43 [auto1.nl] INFO: Saving data for RZ76461: {'created_time': 1774725103.688852, 'last_price_update_time': 1774725103.688863, 'auction_closing_time': 1774883566.0}
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 19:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RZ76461') HTTP/1.1" 204 0
2026-03-28 19:11:43 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 19:11:43 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-28 19:11:43 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 3, <ScrapeType.BATCH_SKIPPED: 5>: 3}
2026-03-28 19:11:43 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (93 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-28T19_10_00.jl
2026-03-28 19:11:43 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 527022,
 'downloader/request_count': 294,
 'downloader/request_method_count/GET': 274,
 'downloader/request_method_count/POST': 20,
 'downloader/response_bytes': 81038647,
 'downloader/response_count': 294,
 'downloader/response_status_count/200': 294,
 'dupefilter/filtered': 5,
 'elapsed_time_seconds': 97.167239,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 19, 11, 43, 799825, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 93,
 'log_count/DEBUG': 3234,
 'log_count/INFO': 3360,
 'memusage/max': 189816832,
 'memusage/startup': 149831680,
 'photo_download_count': 190,
 'request_depth_max': 21,
 'response_received_count': 104,
 'scheduler/dequeued': 294,
 'scheduler/dequeued/memory': 294,
 'scheduler/enqueued': 294,
 'scheduler/enqueued/memory': 294,
 'scrape_type/batch_skipped': 345,
 'scrape_type/new': 41,
 'scrape_type/price_update': 52,
 'scrape_type/skipped': 243,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 104,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.554967852613817,
 'scrapy-zyte-api/mean_response_seconds': 2.584237374875766,
 'scrapy-zyte-api/processed': 104,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 104,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 103,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 104,
 'scrapy-zyte-api/request_args/httpRequestBody': 20,
 'scrapy-zyte-api/request_args/httpRequestMethod': 20,
 'scrapy-zyte-api/request_args/httpResponseBody': 104,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 104,
 'scrapy-zyte-api/request_args/sessionContext': 104,
 'scrapy-zyte-api/request_args/url': 104,
 'scrapy-zyte-api/status_codes/200': 104,
 'scrapy-zyte-api/success': 104,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 686,
 'source/total_available': 646,
 'start_time': datetime.datetime(2026, 3, 28, 19, 10, 6, 632586, tzinfo=datetime.timezone.utc)}
2026-03-28 19:11:43 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 19:11:43 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fd6ea7ce350>
2026-03-28 19:11:43 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fd6ea68c210>