2026-03-28 12:00:11 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 12:00:11 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 12:00:11 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-28 12:00:11 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 12:00:11 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 12:00:11 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 12:00:11 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 12:00:11 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 12:00:11 [scrapy.extensions.telnet] INFO: Telnet Password: 082529221128c164
2026-03-28 12:00:11 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 12:00:11 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-28T12_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 12:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:00:11 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 12:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 12:00:11 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 12:00:11 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 12:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:00:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 12:00:11 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 12:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:11 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 12:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 12:00:11 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 12:00:11 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 12:00:11 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 12:00:11 [scrapy.core.engine] INFO: Spider opened
2026-03-28 12:00:11 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 12:00:11 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 12:00:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 12:00:11 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:00:11 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 12:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 12:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 12:00:21 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 1045 | hits on page: 40
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for PK76759: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for GA63942: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for XH80509: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for ND88147: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for WE18316: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for SS74343: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for YZ60467: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for MZ09465: 1
2026-03-28 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for EG04578: 1
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-28 12:00:21 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-28 12:00:21 [auto1.nl] INFO: Scrape type for PJ49676: 2
2026-03-28 12:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-28 12:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a98ae1-87c8-5da9-b298-6807c53e5094 with scrape type 2
2026-03-28 12:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a98ae1-87c8-5da9-b298-6807c53e5094 with scrape type 2
2026-03-28 12:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 91a98ae1-87c8-5da9-b298-6807c53e5094, identifier: PJ49676
2026-03-28 12:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 12:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 12:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-28 12:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676 to the API
2026-03-28 12:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:03:20Z',
 'fuel_type': 'diesel',
 'id': '91a98ae1-87c8-5da9-b298-6807c53e5094',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ49676',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 231536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [auto1.nl] INFO: Saving data for PJ49676: {'auction_closing_time': 1774883000.0, 'created_time': 1774008047.136506, 'last_price_update_time': 1774699224.416899}
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PJ49676') HTTP/1.1" 204 0
2026-03-28 12:00:24 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-28 12:00:24 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-28 12:00:24 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-28 12:00:24 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [auto1.nl] INFO: Scrape type for TL29950: 0
2026-03-28 12:00:24 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-28 12:00:24 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-28 12:00:24 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-28 12:00:24 [auto1.nl] INFO: Scrape type for GZ48867: 2
2026-03-28 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-28 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c87a53e-b4c9-587f-b08f-930448a40f7d with scrape type 2
2026-03-28 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c87a53e-b4c9-587f-b08f-930448a40f7d with scrape type 2
2026-03-28 12:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0c87a53e-b4c9-587f-b08f-930448a40f7d, identifier: GZ48867
2026-03-28 12:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 12:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-28 12:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867 to the API
2026-03-28 12:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'hybrid',
 'id': '0c87a53e-b4c9-587f-b08f-930448a40f7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ48867',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 117350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Saving data for GZ48867: {'auction_closing_time': 1774883752.0, 'created_time': 1774465315.20143, 'last_price_update_time': 1774699228.347531}
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GZ48867') HTTP/1.1" 204 0
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: UV97115
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV97115%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Scrape type for UV97115: 1
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Scrape type for ZB71006: 1
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Scrape type for DU11939: 0
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Scrape type for KK51574: 1
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Scrape type for AK27162: 1
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Scrape type for KX15971: 1
2026-03-28 12:00:28 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-28 12:00:28 [auto1.nl] INFO: Scrape type for MV10901: 2
2026-03-28 12:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-28 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with scrape type 2
2026-03-28 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with scrape type 2
2026-03-28 12:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9, identifier: MV10901
2026-03-28 12:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 12:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-28 12:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901 to the API
2026-03-28 12:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:26:42Z',
 'fuel_type': 'diesel',
 'id': '0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV10901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 292618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-11',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2014}
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-28 12:00:29 [auto1.nl] INFO: Saving data for MV10901: {'auction_closing_time': 1774884402.0, 'created_time': 1773861244.096813, 'last_price_update_time': 1774699229.842982}
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MV10901') HTTP/1.1" 204 0
2026-03-28 12:00:29 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-28 12:00:29 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-28 12:00:29 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-28 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA63942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK76759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 1045 | hits on page: 40
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-28 12:00:30 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/PK76759/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-28 12:00:30 [auto1.nl] INFO: Scrape type for PJ49676: 0
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-28 12:00:30 [auto1.nl] INFO: Scrape type for TL29950: 0
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-28 12:00:30 [auto1.nl] INFO: Scrape type for GZ48867: 0
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: UV97115
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-28 12:00:30 [auto1.nl] INFO: Scrape type for DU11939: 0
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-28 12:00:30 [auto1.nl] INFO: Scrape type for MV10901: 0
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-28 12:00:30 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE18316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS74343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND88147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV97115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG04578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH80509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ09465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ60467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK51574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB71006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK27162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX15971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 1045 | hits on page: 40
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for ZT51900: 1
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for GN27243: 1
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for NU66962: 1
2026-03-28 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA63942> (referer: https://www.auto1.com/v1/car-details-view/GA63942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for VY08351: 1
2026-03-28 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for XR71865: 1
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for YA06880: 1
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for SE60245: 1
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for KL38892: 1
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for TW61693: 1
2026-03-28 12:00:31 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-28 12:00:31 [auto1.nl] INFO: Scrape type for SE95402: 1
2026-03-28 12:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-28 12:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a812abb7-90f9-58e3-b4be-ec9a14d651d5 with scrape type 1
2026-03-28 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a812abb7-90f9-58e3-b4be-ec9a14d651d5
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_a9b767bba0bf917c15474f1d67d17177.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_a9b767bba0bf917c15474f1d67d17177.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_4530c1b31decb0bfde1a168bcedc1188.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_4530c1b31decb0bfde1a168bcedc1188.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_6f91fd0e4555a95a51261fbd04985b3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_6f91fd0e4555a95a51261fbd04985b3e.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_cb0f5fff1ae6335f3342636eba39706d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_cb0f5fff1ae6335f3342636eba39706d.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_9c1090b3c36fdd832cd31577e2d203d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_9c1090b3c36fdd832cd31577e2d203d3.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_83f7e21d79e03df19f9484de8d64882f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_83f7e21d79e03df19f9484de8d64882f.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_d7b50d4be282c4ad63bbf89328fa17d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_d7b50d4be282c4ad63bbf89328fa17d8.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_218f8726c8596e45ff9d0f880c72dc9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_218f8726c8596e45ff9d0f880c72dc9e.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_74d215e6c9d720dc5d65369d1b37fd34.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_74d215e6c9d720dc5d65369d1b37fd34.jpg already downloaded
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F07%252Fcf07e990940d237cb9e1c4f9f938f292%252Fpa%252FGA63942_42b0299d5f93d6760e6f0cb08649a16f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_42b0299d5f93d6760e6f0cb08649a16f.jpg already downloaded
2026-03-28 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a812abb7-90f9-58e3-b4be-ec9a14d651d5, identifier: GA63942
2026-03-28 12:00:32 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-28 12:00:32 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-28 12:00:32 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-28 12:00:32 [auto1.nl] INFO: Scrape type for RK78214: 1
2026-03-28 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-28 12:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942 to the API
2026-03-28 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GA63942>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:19Z',
 'fuel_type': 'petrol',
 'id': 'a812abb7-90f9-58e3-b4be-ec9a14d651d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'r651dp',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA63942',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 150632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_a9b767bba0bf917c15474f1d67d17177.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_4530c1b31decb0bfde1a168bcedc1188.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_6f91fd0e4555a95a51261fbd04985b3e.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_cb0f5fff1ae6335f3342636eba39706d.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_9c1090b3c36fdd832cd31577e2d203d3.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_83f7e21d79e03df19f9484de8d64882f.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_d7b50d4be282c4ad63bbf89328fa17d8.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_218f8726c8596e45ff9d0f880c72dc9e.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_74d215e6c9d720dc5d65369d1b37fd34.jpg',
                'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_42b0299d5f93d6760e6f0cb08649a16f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_a9b767bba0bf917c15474f1d67d17177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55345,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_4530c1b31decb0bfde1a168bcedc1188.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_6f91fd0e4555a95a51261fbd04985b3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48265,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_cb0f5fff1ae6335f3342636eba39706d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48358,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_9c1090b3c36fdd832cd31577e2d203d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51164,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_83f7e21d79e03df19f9484de8d64882f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45616,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_d7b50d4be282c4ad63bbf89328fa17d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_218f8726c8596e45ff9d0f880c72dc9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_74d215e6c9d720dc5d65369d1b37fd34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a812abb7-90f9-58e3-b4be-ec9a14d651d5/a812abb7-90f9-58e3-b4be-ec9a14d651d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/07/cf07e990940d237cb9e1c4f9f938f292/pa/GA63942_42b0299d5f93d6760e6f0cb08649a16f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 I-Way',
 'transmission': 'automatic',
 'trim': 'I-Way',
 'year': 2011}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.nl] INFO: Saving data for GA63942: {'created_time': 1774699233.180321, 'last_price_update_time': 1774699233.180329, 'auction_closing_time': 1774883059.0}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA63942') HTTP/1.1" 204 0
2026-03-28 12:00:33 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-28 12:00:33 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.nl] INFO: Scrape type for EW45242: 2
2026-03-28 12:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-28 12:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08aa1f0-8b82-5feb-a925-af208e6cf76b with scrape type 2
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c08aa1f0-8b82-5feb-a925-af208e6cf76b with scrape type 2
2026-03-28 12:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c08aa1f0-8b82-5feb-a925-af208e6cf76b, identifier: EW45242
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK76759> (referer: https://www.auto1.com/v1/car-details-view/PK76759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG04578> (referer: https://www.auto1.com/v1/car-details-view/EG04578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH80509> (referer: https://www.auto1.com/v1/car-details-view/XH80509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE18316> (referer: https://www.auto1.com/v1/car-details-view/WE18316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS74343> (referer: https://www.auto1.com/v1/car-details-view/SS74343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND88147> (referer: https://www.auto1.com/v1/car-details-view/ND88147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-28 12:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242 to the API
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:16Z',
 'fuel_type': 'petrol',
 'id': 'c08aa1f0-8b82-5feb-a925-af208e6cf76b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW45242',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 274552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.nl] INFO: Saving data for EW45242: {'auction_closing_time': 1774885876.0, 'created_time': 1773774238.383516, 'last_price_update_time': 1774699233.884176}
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW45242') HTTP/1.1" 204 0
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV97115> (referer: https://www.auto1.com/v1/car-details-view/UV97115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:33 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-28 12:00:33 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.nl] INFO: Scrape type for UA80107: 1
2026-03-28 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:33 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [auto1.nl] INFO: Scrape type for UH76205: 1
2026-03-28 12:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759
2026-03-28 12:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd23808-ff64-5851-853c-f5825419ed70 with scrape type 1
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4fd23808-ff64-5851-853c-f5825419ed70
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_697214f3288e8b6e224a9055cc52e622.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_697214f3288e8b6e224a9055cc52e622.jpg not downloaded yet
2026-03-28 12:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578
2026-03-28 12:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e138907-1898-58c8-850b-a799c8ed88b0 with scrape type 1
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_7ccb4cfe1bc46bca9fd5208924958cf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_7ccb4cfe1bc46bca9fd5208924958cf2.jpg not downloaded yet
2026-03-28 12:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509
2026-03-28 12:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b26de1a-f963-5b9a-8aac-8f401962dc78 with scrape type 1
2026-03-28 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_d5c80e5d69696e388ecdcce233ddec91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d5c80e5d69696e388ecdcce233ddec91.jpg not downloaded yet
2026-03-28 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316
2026-03-28 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b with scrape type 1
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_2656821f170e24e00b5dca9ce63e447c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_2656821f170e24e00b5dca9ce63e447c.jpg not downloaded yet
2026-03-28 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343
2026-03-28 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with scrape type 1
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_07295f8c742a97958ea069a94006c6f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_07295f8c742a97958ea069a94006c6f7.jpg not downloaded yet
2026-03-28 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-28 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387baa92-9d7d-52d8-ab82-6a055485c20b with scrape type 1
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 387baa92-9d7d-52d8-ab82-6a055485c20b
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5c%252F505cb1ad0c9bce249642bb1b974db545%252Fpa%252FND88147_9b3f2218e48a46f6732f5f7e6e821c99.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_9b3f2218e48a46f6732f5f7e6e821c99.jpg already downloaded
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5c%252F505cb1ad0c9bce249642bb1b974db545%252Fpa%252FND88147_2734fb1dd5d3e60a516477ae28be9c91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_2734fb1dd5d3e60a516477ae28be9c91.jpg already downloaded
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5c%252F505cb1ad0c9bce249642bb1b974db545%252Fpa%252FND88147_cd0b51cb32a91f0a2e558941f5539bf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_cd0b51cb32a91f0a2e558941f5539bf1.jpg already downloaded
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5c%252F505cb1ad0c9bce249642bb1b974db545%252Fpa%252FND88147_0cde95ea63642565fa0dbe1cec084d92.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_0cde95ea63642565fa0dbe1cec084d92.jpg already downloaded
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5c%252F505cb1ad0c9bce249642bb1b974db545%252Fpa%252FND88147_81a8e768ea141bf377d0c614abbca2ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_81a8e768ea141bf377d0c614abbca2ac.jpg already downloaded
2026-03-28 12:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 387baa92-9d7d-52d8-ab82-6a055485c20b, identifier: ND88147
2026-03-28 12:00:34 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-28 12:00:34 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-28 12:00:34 [auto1.nl] INFO: Scrape type for KX92525: 1
2026-03-28 12:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 12:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-28 12:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147 to the API
2026-03-28 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ND88147>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:20:33Z',
 'fuel_type': 'petrol',
 'id': '387baa92-9d7d-52d8-ab82-6a055485c20b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '12HKX2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND88147',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 271602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_9b3f2218e48a46f6732f5f7e6e821c99.jpg',
                'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_2734fb1dd5d3e60a516477ae28be9c91.jpg',
                'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_cd0b51cb32a91f0a2e558941f5539bf1.jpg',
                'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_0cde95ea63642565fa0dbe1cec084d92.jpg',
                'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_81a8e768ea141bf377d0c614abbca2ac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387baa92-9d7d-52d8-ab82-6a055485c20b/387baa92-9d7d-52d8-ab82-6a055485c20b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_9b3f2218e48a46f6732f5f7e6e821c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387baa92-9d7d-52d8-ab82-6a055485c20b/387baa92-9d7d-52d8-ab82-6a055485c20b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_2734fb1dd5d3e60a516477ae28be9c91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387baa92-9d7d-52d8-ab82-6a055485c20b/387baa92-9d7d-52d8-ab82-6a055485c20b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_cd0b51cb32a91f0a2e558941f5539bf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387baa92-9d7d-52d8-ab82-6a055485c20b/387baa92-9d7d-52d8-ab82-6a055485c20b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_0cde95ea63642565fa0dbe1cec084d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387baa92-9d7d-52d8-ab82-6a055485c20b/387baa92-9d7d-52d8-ab82-6a055485c20b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5c/505cb1ad0c9bce249642bb1b974db545/pa/ND88147_81a8e768ea141bf377d0c614abbca2ac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [auto1.nl] INFO: Saving data for ND88147: {'created_time': 1774699235.579411, 'last_price_update_time': 1774699235.579422, 'auction_closing_time': 1774884033.0}
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ND88147') HTTP/1.1" 204 0
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_18d29fc7ba389c54966bc0c217d612fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_18d29fc7ba389c54966bc0c217d612fc.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_3c8da44a34c1fb22b45bd14fed9f0daf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_3c8da44a34c1fb22b45bd14fed9f0daf.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_323155f586effcdd03363e0239fea1c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_323155f586effcdd03363e0239fea1c2.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_f15ac90942b52f1c712b427620dff85f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_f15ac90942b52f1c712b427620dff85f.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_0fd14130ecf0a21791b892fea764bc18.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_0fd14130ecf0a21791b892fea764bc18.jpg not downloaded yet
2026-03-28 12:00:35 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [auto1.nl] INFO: Scrape type for UU92994: 1
2026-03-28 12:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ09465> (referer: https://www.auto1.com/v1/car-details-view/MZ09465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_a9291ed4813591ff903530d242b573a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_a9291ed4813591ff903530d242b573a6.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_5ce7e9d593bbad69430e86c2947fd8fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_5ce7e9d593bbad69430e86c2947fd8fc.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_d61faea5f41fa1315fdb12fe10de111f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d61faea5f41fa1315fdb12fe10de111f.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_8a948cf7da9389c1ec123f61ca67ef72.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_8a948cf7da9389c1ec123f61ca67ef72.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_34dcc940d2359aea64c530c24ed223fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_34dcc940d2359aea64c530c24ed223fa.jpg not downloaded yet
2026-03-28 12:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606068ae-7bcd-5d60-8159-09e17b7dba03 with identifier: UV97115
2026-03-28 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606068ae-7bcd-5d60-8159-09e17b7dba03 with scrape type 1
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_cc9650711d5504e1c2805c6d812283ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_cc9650711d5504e1c2805c6d812283ff.jpg not downloaded yet
2026-03-28 12:00:35 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [auto1.nl] INFO: Scrape type for WY17438: 1
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_7261c388864ae9e7b631038a8a6432be.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_7261c388864ae9e7b631038a8a6432be.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_4658a4c5c59f1b3aa91b37b3c1347f3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_4658a4c5c59f1b3aa91b37b3c1347f3b.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_e0604f947c9091ad010002ecf6628f57.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_e0604f947c9091ad010002ecf6628f57.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_225499c1fb5c6396c5f080b8ee9668bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_225499c1fb5c6396c5f080b8ee9668bf.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_736ade5bc86ed9bb80604e484d0d1766.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_736ade5bc86ed9bb80604e484d0d1766.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_49a420588fb313928fc45816e6069367.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_49a420588fb313928fc45816e6069367.jpg not downloaded yet
2026-03-28 12:00:35 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-28 12:00:35 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [auto1.nl] INFO: Scrape type for ZS54708: 1
2026-03-28 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465
2026-03-28 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 426a13f9-a2cd-50b3-b345-1f62e662d16a with scrape type 1
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_5d60240edb124fabee092db462cd2568.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5d60240edb124fabee092db462cd2568.jpg not downloaded yet
2026-03-28 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_0f1dce121e92c984d7efdbe19c679b5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_0f1dce121e92c984d7efdbe19c679b5d.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_761ba7743f1800bf87fbf85e64722178.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_761ba7743f1800bf87fbf85e64722178.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_9c0806affb2111898d45005ecce882b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9c0806affb2111898d45005ecce882b2.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_e4dd9b28f0d5a32828158e217c21900a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_e4dd9b28f0d5a32828158e217c21900a.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_e96f0885be301f2b4d65e6f75be711b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_e96f0885be301f2b4d65e6f75be711b5.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_e82a5d38bab92ec10f39568089ae95f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_e82a5d38bab92ec10f39568089ae95f9.jpg not downloaded yet
2026-03-28 12:00:36 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-28 12:00:36 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.nl] INFO: Scrape type for BB32456: 1
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_db2ef770fbbd34046e96d1b3675d69ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_db2ef770fbbd34046e96d1b3675d69ea.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_ce24686e78617db51091170f7fd7e434.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_ce24686e78617db51091170f7fd7e434.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_958291d42fac88712e4810619eb55ad7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_958291d42fac88712e4810619eb55ad7.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_1dbdc68fb96eeeacfc43ee2c05bb5827.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_1dbdc68fb96eeeacfc43ee2c05bb5827.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_67dd638b414d42b99290f0c946d7ed54.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_67dd638b414d42b99290f0c946d7ed54.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_3b6f4e5848254ab61a302db934046e77.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_3b6f4e5848254ab61a302db934046e77.jpg not downloaded yet
2026-03-28 12:00:36 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-28 12:00:36 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.nl] INFO: Scrape type for WW25859: 1
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_56c88cffa41f4048503a49bde8f61319.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_56c88cffa41f4048503a49bde8f61319.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_dd56ae221a0475c1346f4a2df9864c12.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_dd56ae221a0475c1346f4a2df9864c12.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_5f2dbb5e5f832e327e2316420a6c3aa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_5f2dbb5e5f832e327e2316420a6c3aa8.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_3718a4d9e62a8cebecabb7e8d61a70ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3718a4d9e62a8cebecabb7e8d61a70ca.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_2379eea96d2a42de10bcfee8a90dd606.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_2379eea96d2a42de10bcfee8a90dd606.jpg not downloaded yet
2026-03-28 12:00:36 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-28 12:00:36 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.nl] INFO: Scrape type for BP52845: 1
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_3ea3ace75c00fc1a474060ec614740a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_3ea3ace75c00fc1a474060ec614740a0.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_111f02ec411144635c1efcd3e0957fb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_111f02ec411144635c1efcd3e0957fb7.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_836c87de11db47fb35b8b5fd945b6e5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_836c87de11db47fb35b8b5fd945b6e5b.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_d745a60d72cc1f12f223606b94b20e6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_d745a60d72cc1f12f223606b94b20e6f.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_936d4507b283041d7f33e64e6687e1fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_936d4507b283041d7f33e64e6687e1fa.jpg not downloaded yet
2026-03-28 12:00:36 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [auto1.nl] INFO: Scrape type for DX51815: 1
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_a1c009d0dabee9ea755f440f7f3b08bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_a1c009d0dabee9ea755f440f7f3b08bd.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_37148a45477ad36fc5e925e725757805.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_37148a45477ad36fc5e925e725757805.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_9fb8c0d63ca48471e6d4f5eb8013557a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9fb8c0d63ca48471e6d4f5eb8013557a.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_3702281608a06679f1d6bf4a558dd0f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3702281608a06679f1d6bf4a558dd0f9.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_a76ca7c4807a74918f7c6726863070e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_a76ca7c4807a74918f7c6726863070e4.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_38978a1563448ea64414dcb9bbc6f9ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_38978a1563448ea64414dcb9bbc6f9ba.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_8dce7e03228eb1ab85394f3bf2770da9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_8dce7e03228eb1ab85394f3bf2770da9.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_826ad4d5252104e9fbaeeaa65f2028b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_826ad4d5252104e9fbaeeaa65f2028b8.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_af0ddd1602a4c3a45f3185567fc85d7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_af0ddd1602a4c3a45f3185567fc85d7c.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_70aacfe267003da2d72f950fe9cf3456.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_70aacfe267003da2d72f950fe9cf3456.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_c0eb5bdc6cd4fe980f57ac83893386f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c0eb5bdc6cd4fe980f57ac83893386f6.jpg not downloaded yet
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK27162> (referer: https://www.auto1.com/v1/car-details-view/AK27162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_0fd14130ecf0a21791b892fea764bc18.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_bd144983034541a0be26bfd87fdb16cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_bd144983034541a0be26bfd87fdb16cc.jpg not downloaded yet
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_5312d5ff00e9f83f7d301bfeae8044e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5312d5ff00e9f83f7d301bfeae8044e4.jpg not downloaded yet
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB71006> (referer: https://www.auto1.com/v1/car-details-view/ZB71006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_4de141f33064d3277608bd1bda2f1dc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_4de141f33064d3277608bd1bda2f1dc4.jpg not downloaded yet
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ60467> (referer: https://www.auto1.com/v1/car-details-view/YZ60467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX15971> (referer: https://www.auto1.com/v1/car-details-view/KX15971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_430f9e70c3d7ddf20c0f67148fdc7296.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_430f9e70c3d7ddf20c0f67148fdc7296.jpg not downloaded yet
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT51900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_c268dcc20e80ab8f391ef21daea5ce47.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c268dcc20e80ab8f391ef21daea5ce47.jpg not downloaded yet
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK51574> (referer: https://www.auto1.com/v1/car-details-view/KK51574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-28 12:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29dff94-6ab8-5f78-aa8c-49d7297720b8 with scrape type 1
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_e96ef8fdd3d2b2db172d21575d0169b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e96ef8fdd3d2b2db172d21575d0169b3.jpg not downloaded yet
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_7d4a3fcfff3d4d56e956fc75bd0402b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_7d4a3fcfff3d4d56e956fc75bd0402b8.jpg not downloaded yet
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbadd910>
2026-03-28 12:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_0fd14130ecf0a21791b892fea764bc18.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_0fd14130ecf0a21791b892fea764bc18.jpg saved to cache
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70
2026-03-28 12:00:37 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 1045 | hits on page: 40
2026-03-28 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-28 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5333bba5-93d3-52c1-b6ec-9f61023e9919 with scrape type 1
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_0716d51e1e9b7d20aa661614e55efb82.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_0716d51e1e9b7d20aa661614e55efb82.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_123261c02f01ce746c90fbacfa551361.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_123261c02f01ce746c90fbacfa551361.jpg not downloaded yet
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.nl] INFO: Scrape type for NJ12224: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_19052a52100914fdcca6ecfb79fe5fa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_19052a52100914fdcca6ecfb79fe5fa3.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_43ea420ac88824728500061c53f4f41a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_43ea420ac88824728500061c53f4f41a.jpg not downloaded yet
2026-03-28 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-28 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348a5638-421f-592d-9f06-e9ad8871cc4f with scrape type 1
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_8d669632a55b158f489103fc7e494f3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8d669632a55b158f489103fc7e494f3a.jpg not downloaded yet
2026-03-28 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-28 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with scrape type 1
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_c2e319a998060f1ce5df1c346cbae369.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_c2e319a998060f1ce5df1c346cbae369.jpg not downloaded yet
2026-03-28 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-28 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with scrape type 1
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_0996d9324ff5d58cfee34856b1c278c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_0996d9324ff5d58cfee34856b1c278c3.jpg not downloaded yet
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.nl] INFO: Scrape type for DJ46393: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_61503ccb149ad9c958bf21bf802e0a52.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_61503ccb149ad9c958bf21bf802e0a52.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_1665bdb84a113e80aa8698b96d2bd64e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_1665bdb84a113e80aa8698b96d2bd64e.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_c954cf0cd0de3a1677280e1c521ebb6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_c954cf0cd0de3a1677280e1c521ebb6e.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_e85852f855cddc75ed33184fa547600b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_e85852f855cddc75ed33184fa547600b.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_41fd0ae092a9f6051b67542a51c2d486.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_41fd0ae092a9f6051b67542a51c2d486.jpg not downloaded yet
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.nl] INFO: Scrape type for JF84007: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_ac3138e070f740fc7365b8de3ec85f72.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_ac3138e070f740fc7365b8de3ec85f72.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_2c1a41693ca184497496c02de5bf36b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_2c1a41693ca184497496c02de5bf36b7.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_a242419b90e94f7ee6eecb957ecefcce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a242419b90e94f7ee6eecb957ecefcce.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_dc33e7e927d7d72b2839c77111774ea5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_dc33e7e927d7d72b2839c77111774ea5.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_00da5c8576ae7edbffa2cc6067b829ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_00da5c8576ae7edbffa2cc6067b829ed.jpg not downloaded yet
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c0eb5bdc6cd4fe980f57ac83893386f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.nl] INFO: Scrape type for KD48941: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_d39bb3672e98316185379c7995dfff69.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_d39bb3672e98316185379c7995dfff69.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_4c65f30fda3f90ef00703187d2fb7e6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_4c65f30fda3f90ef00703187d2fb7e6e.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_969096f404f75ce776db78204d9bf6e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_969096f404f75ce776db78204d9bf6e2.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_b59acde9d58a87546bf81a3b03e67a18.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_b59acde9d58a87546bf81a3b03e67a18.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_638ca85295094a96fbdb807c01953c8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_638ca85295094a96fbdb807c01953c8a.jpg not downloaded yet
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_826ad4d5252104e9fbaeeaa65f2028b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.nl] INFO: Scrape type for EU38085: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_e2f91e71efbafbc28cd985ea0aa56058.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_e2f91e71efbafbc28cd985ea0aa56058.jpg not downloaded yet
2026-03-28 12:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5312d5ff00e9f83f7d301bfeae8044e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_6601216adc06908f94a1e9aa9ad98ce9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_6601216adc06908f94a1e9aa9ad98ce9.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_a484e6b5cad40f631410b8d52a51d473.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a484e6b5cad40f631410b8d52a51d473.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_92477f77643bc6402f7f1e42cf9822f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_92477f77643bc6402f7f1e42cf9822f9.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_1827d3d5557a6e0079703c774f2b0ae7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_1827d3d5557a6e0079703c774f2b0ae7.jpg not downloaded yet
2026-03-28 12:00:37 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [auto1.nl] INFO: Scrape type for WN94746: 1
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_18fb131d4add338b12ee7944d6c50164.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_18fb131d4add338b12ee7944d6c50164.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_dad3bc956c8c6a3e278634c57aab6558.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_dad3bc956c8c6a3e278634c57aab6558.jpg not downloaded yet
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_6b483517188b3e092bc98774b6089322.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_6b483517188b3e092bc98774b6089322.jpg not downloaded yet
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.nl] INFO: Scrape type for WU56616: 1
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_972ba0cb02f22998ea1fd43d294937a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_972ba0cb02f22998ea1fd43d294937a9.jpg not downloaded yet
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb86d790>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_c0eb5bdc6cd4fe980f57ac83893386f6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c0eb5bdc6cd4fe980f57ac83893386f6.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac0ba10>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_826ad4d5252104e9fbaeeaa65f2028b8.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_826ad4d5252104e9fbaeeaa65f2028b8.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_430f9e70c3d7ddf20c0f67148fdc7296.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_e6dbb6221b92d4e8013a5724e7a202a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e6dbb6221b92d4e8013a5724e7a202a5.jpg not downloaded yet
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_00dae0ee440b828cdd9beba73df199cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_00dae0ee440b828cdd9beba73df199cc.jpg not downloaded yet
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_b59acde9d58a87546bf81a3b03e67a18.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_ac3138e070f740fc7365b8de3ec85f72.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_638ca85295094a96fbdb807c01953c8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.nl] INFO: Scrape type for CT48510: 1
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_087c102d488d2b1403d27eacd9becd6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_087c102d488d2b1403d27eacd9becd6b.jpg not downloaded yet
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK78214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE95402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE60245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafb7c10>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_5312d5ff00e9f83f7d301bfeae8044e4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5312d5ff00e9f83f7d301bfeae8044e4.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_f2be87b24499746642bb82b5578c141d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_f2be87b24499746642bb82b5578c141d.jpg not downloaded yet
2026-03-28 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU66962/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL38892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.nl] INFO: Scrape type for RD76922: 1
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_7f0824cff829956145e68a997bb5c3f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_7f0824cff829956145e68a997bb5c3f4.jpg not downloaded yet
2026-03-28 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_8e14340bbde5efaed52a7ce8224bea4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8e14340bbde5efaed52a7ce8224bea4b.jpg not downloaded yet
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafa09d0>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_430f9e70c3d7ddf20c0f67148fdc7296.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_430f9e70c3d7ddf20c0f67148fdc7296.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-28 12:00:38 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-28 12:00:38 [auto1.nl] INFO: Scrape type for WC26387: 2
2026-03-28 12:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-28 12:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a02d6d4-f622-5010-9d10-9b4d747b9630 with scrape type 2
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a02d6d4-f622-5010-9d10-9b4d747b9630 with scrape type 2
2026-03-28 12:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a02d6d4-f622-5010-9d10-9b4d747b9630, identifier: WC26387
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba0a490>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_b59acde9d58a87546bf81a3b03e67a18.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_b59acde9d58a87546bf81a3b03e67a18.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac174d0>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_ac3138e070f740fc7365b8de3ec85f72.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_ac3138e070f740fc7365b8de3ec85f72.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf25bd0>
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_638ca85295094a96fbdb807c01953c8a.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_638ca85295094a96fbdb807c01953c8a.jpg saved to cache
2026-03-28 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7
2026-03-28 12:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-28 12:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-28 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387 to the API
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:52:53Z',
 'fuel_type': 'diesel',
 'id': '8a02d6d4-f622-5010-9d10-9b4d747b9630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC26387',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 271792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2010}
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.nl] INFO: Saving data for WC26387: {'auction_closing_time': 1774885973.0, 'created_time': 1774008059.084225, 'last_price_update_time': 1774699239.265744}
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC26387') HTTP/1.1" 204 0
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_b99cf1df2cb257fa70fbf0e5fb1e6ad7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_b99cf1df2cb257fa70fbf0e5fb1e6ad7.jpg not downloaded yet
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.nl] INFO: Scrape type for LF00808: 1
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA06880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_dad3bc956c8c6a3e278634c57aab6558.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_6b483517188b3e092bc98774b6089322.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_00dae0ee440b828cdd9beba73df199cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW61693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR71865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.nl] INFO: Scrape type for JM92964: 1
2026-03-28 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-28 12:00:39 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-28 12:00:39 [auto1.nl] INFO: Scrape type for HJ37238: 2
2026-03-28 12:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-28 12:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 2
2026-03-28 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 2
2026-03-28 12:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 473c01f0-6dff-59e4-b78f-b7bd6be80c04, identifier: HJ37238
2026-03-28 12:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-28 12:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-28 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238 to the API
2026-03-28 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:54:27Z',
 'fuel_type': 'diesel',
 'id': '473c01f0-6dff-59e4-b78f-b7bd6be80c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ37238',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 229510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Compact Basis',
 'transmission': 'manual',
 'trim': 'Rapid Compact Basis',
 'year': 2019}
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.nl] INFO: Saving data for HJ37238: {'auction_closing_time': 1774886067.0, 'created_time': 1774002028.690083, 'last_price_update_time': 1774699240.249794}
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ37238') HTTP/1.1" 204 0
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.nl] INFO: Scrape type for JK34334: 1
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac4a750>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_dad3bc956c8c6a3e278634c57aab6558.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_dad3bc956c8c6a3e278634c57aab6558.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac0cb10>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_6b483517188b3e092bc98774b6089322.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_6b483517188b3e092bc98774b6089322.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac0d3d0>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_00dae0ee440b828cdd9beba73df199cc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_00dae0ee440b828cdd9beba73df199cc.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e6dbb6221b92d4e8013a5724e7a202a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_087c102d488d2b1403d27eacd9becd6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_18fb131d4add338b12ee7944d6c50164.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.nl] INFO: Scrape type for YB88576: 1
2026-03-28 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.nl] INFO: Scrape type for YG37971: 1
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.nl] INFO: Scrape type for UF88780: 1
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-28 12:00:40 [auto1.nl] INFO: Scrape type for KC88699: 1
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_70aacfe267003da2d72f950fe9cf3456.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-28 12:00:40 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb63d90>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_e6dbb6221b92d4e8013a5724e7a202a5.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e6dbb6221b92d4e8013a5724e7a202a5.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9ddf50>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_087c102d488d2b1403d27eacd9becd6b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_087c102d488d2b1403d27eacd9becd6b.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac41d10>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_18fb131d4add338b12ee7944d6c50164.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_18fb131d4add338b12ee7944d6c50164.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_bd144983034541a0be26bfd87fdb16cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8e14340bbde5efaed52a7ce8224bea4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_b99cf1df2cb257fa70fbf0e5fb1e6ad7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cabea890>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_70aacfe267003da2d72f950fe9cf3456.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_70aacfe267003da2d72f950fe9cf3456.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_af0ddd1602a4c3a45f3185567fc85d7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_7f0824cff829956145e68a997bb5c3f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba1c5d0>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_bd144983034541a0be26bfd87fdb16cc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_bd144983034541a0be26bfd87fdb16cc.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac3fad0>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_8e14340bbde5efaed52a7ce8224bea4b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8e14340bbde5efaed52a7ce8224bea4b.jpg saved to cache
2026-03-28 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8e1d50>
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_b99cf1df2cb257fa70fbf0e5fb1e6ad7.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_b99cf1df2cb257fa70fbf0e5fb1e6ad7.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT48510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU56616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_4de141f33064d3277608bd1bda2f1dc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbb4a10>
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_af0ddd1602a4c3a45f3185567fc85d7c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_af0ddd1602a4c3a45f3185567fc85d7c.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb9cf50>
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_7f0824cff829956145e68a997bb5c3f4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_7f0824cff829956145e68a997bb5c3f4.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_972ba0cb02f22998ea1fd43d294937a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL38892> (referer: https://www.auto1.com/v1/car-details-view/KL38892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8e1090>
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_4de141f33064d3277608bd1bda2f1dc4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_4de141f33064d3277608bd1bda2f1dc4.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU66962> (referer: https://www.auto1.com/v1/car-details-view/NU66962/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb5ee90>
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_972ba0cb02f22998ea1fd43d294937a9.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_972ba0cb02f22998ea1fd43d294937a9.jpg saved to cache
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-28 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62f588c-3746-59a5-a305-46f68cb734f2 with scrape type 1
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_faaa8c582b2b65ab0866a72855503444.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_faaa8c582b2b65ab0866a72855503444.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_d20146823e780ec8d596ebc6fdcd1453.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_d20146823e780ec8d596ebc6fdcd1453.jpg not downloaded yet
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR71865> (referer: https://www.auto1.com/v1/car-details-view/XR71865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_9a8b33a73f0c8ed63def5ff820adc05c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9a8b33a73f0c8ed63def5ff820adc05c.jpg not downloaded yet
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-28 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6803cc5-9c85-5100-a40c-c7330b413d80 with scrape type 1
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_63eaf24e9d2f3d2918e17c11d0b0dc0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_63eaf24e9d2f3d2918e17c11d0b0dc0c.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_dd15ae610988673a22f0b2d7b4c6131b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_dd15ae610988673a22f0b2d7b4c6131b.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_0adef5a12788432990cf6b072564041c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0adef5a12788432990cf6b072564041c.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_9bc97c3075f49f4c9342814ec6bd3b40.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9bc97c3075f49f4c9342814ec6bd3b40.jpg not downloaded yet
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD76922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA06880> (referer: https://www.auto1.com/v1/car-details-view/YA06880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_3ec66586c00c6546c689cad2d6d3702c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_3ec66586c00c6546c689cad2d6d3702c.jpg not downloaded yet
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_86743b934124156fb050a7306a857be7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_86743b934124156fb050a7306a857be7.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_48e20e94790dd49e5e1cd0bce95153f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_48e20e94790dd49e5e1cd0bce95153f8.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_25314336f0e53bc53f3b9f76d071f272.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_25314336f0e53bc53f3b9f76d071f272.jpg not downloaded yet
2026-03-28 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_d20146823e780ec8d596ebc6fdcd1453.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_c365c7b8ed470e06073a0d5f2ec716b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_c365c7b8ed470e06073a0d5f2ec716b3.jpg not downloaded yet
2026-03-28 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-28 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c2eb86-b403-52aa-a592-971506686848 with scrape type 1
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_27c4c1b21a9f5d8385b04171211279d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_27c4c1b21a9f5d8385b04171211279d4.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_737307a834787c57e286d89d60166682.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_737307a834787c57e286d89d60166682.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_ceef47860ed47d61099d79fa5b41925d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_ceef47860ed47d61099d79fa5b41925d.jpg not downloaded yet
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_1c3ad3a22e92821b1ede0d1757b85a2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_1c3ad3a22e92821b1ede0d1757b85a2d.jpg not downloaded yet
2026-03-28 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-28 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd4db4de-0d3b-545b-a982-fe02e5dc0961 with scrape type 1
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cd4db4de-0d3b-545b-a982-fe02e5dc0961
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4a%252Fbb4aa91adfec06c35558247238d7717d%252Fpa%252FYA06880_01f5ed9f0ecf6fed6b7bbbbf4a651b2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_01f5ed9f0ecf6fed6b7bbbbf4a651b2b.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4a%252Fbb4aa91adfec06c35558247238d7717d%252Fpa%252FYA06880_d715d590f969fa752b138ffda28afc02.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_d715d590f969fa752b138ffda28afc02.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4a%252Fbb4aa91adfec06c35558247238d7717d%252Fpa%252FYA06880_da1217e2f6314ef2c65c8298c41736ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_da1217e2f6314ef2c65c8298c41736ca.jpg already downloaded
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4a%252Fbb4aa91adfec06c35558247238d7717d%252Fpa%252FYA06880_db7aeaae019755e2d23917469a02c17e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_db7aeaae019755e2d23917469a02c17e.jpg already downloaded
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F4a%252Fbb4aa91adfec06c35558247238d7717d%252Fpa%252FYA06880_f33d3783680cb4f26155a3ab01de0100.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_f33d3783680cb4f26155a3ab01de0100.jpg already downloaded
2026-03-28 12:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd4db4de-0d3b-545b-a982-fe02e5dc0961, identifier: YA06880
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9bc97c3075f49f4c9342814ec6bd3b40.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_a9896ca6a8db8065d64831852b8638ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_a9896ca6a8db8065d64831852b8638ad.jpg not downloaded yet
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_4fb4d1fb209fb41a158640e2933a87ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_4fb4d1fb209fb41a158640e2933a87ca.jpg not downloaded yet
2026-03-28 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-28 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-28 12:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880 to the API
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YA06880>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:44:40Z',
 'fuel_type': 'diesel',
 'id': 'cd4db4de-0d3b-545b-a982-fe02e5dc0961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '59HNJ9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA06880',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'BMW',
 'model': '1er',
 'odometer': 377969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_01f5ed9f0ecf6fed6b7bbbbf4a651b2b.jpg',
                'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_d715d590f969fa752b138ffda28afc02.jpg',
                'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_da1217e2f6314ef2c65c8298c41736ca.jpg',
                'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_db7aeaae019755e2d23917469a02c17e.jpg',
                'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_f33d3783680cb4f26155a3ab01de0100.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd4db4de-0d3b-545b-a982-fe02e5dc0961/cd4db4de-0d3b-545b-a982-fe02e5dc0961_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_01f5ed9f0ecf6fed6b7bbbbf4a651b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd4db4de-0d3b-545b-a982-fe02e5dc0961/cd4db4de-0d3b-545b-a982-fe02e5dc0961_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_d715d590f969fa752b138ffda28afc02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd4db4de-0d3b-545b-a982-fe02e5dc0961/cd4db4de-0d3b-545b-a982-fe02e5dc0961_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_da1217e2f6314ef2c65c8298c41736ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd4db4de-0d3b-545b-a982-fe02e5dc0961/cd4db4de-0d3b-545b-a982-fe02e5dc0961_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_db7aeaae019755e2d23917469a02c17e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd4db4de-0d3b-545b-a982-fe02e5dc0961/cd4db4de-0d3b-545b-a982-fe02e5dc0961_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/4a/bb4aa91adfec06c35558247238d7717d/pa/YA06880_f33d3783680cb4f26155a3ab01de0100.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [auto1.nl] INFO: Saving data for YA06880: {'created_time': 1774699242.645578, 'last_price_update_time': 1774699242.64559, 'auction_closing_time': 1774885480.0}
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YA06880') HTTP/1.1" 204 0
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_48e20e94790dd49e5e1cd0bce95153f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0adef5a12788432990cf6b072564041c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_0e8e73b19e50e22ef6283d1ea71e68c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0e8e73b19e50e22ef6283d1ea71e68c5.jpg not downloaded yet
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_504fd5072bb1afc8415c766629a256d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_504fd5072bb1afc8415c766629a256d8.jpg not downloaded yet
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF88780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW61693> (referer: https://www.auto1.com/v1/car-details-view/TW61693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG37971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC88699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB88576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf40d50>
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_d20146823e780ec8d596ebc6fdcd1453.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_d20146823e780ec8d596ebc6fdcd1453.jpg saved to cache
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb59fd0>
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_9bc97c3075f49f4c9342814ec6bd3b40.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9bc97c3075f49f4c9342814ec6bd3b40.jpg saved to cache
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_1c3ad3a22e92821b1ede0d1757b85a2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_0aec9e352bad2a1e0484525b37f8cd8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0aec9e352bad2a1e0484525b37f8cd8c.jpg not downloaded yet
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_8b271666c2bd5d8ba0492a9706bc1353.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_8b271666c2bd5d8ba0492a9706bc1353.jpg not downloaded yet
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_8aed8bf27e7a0ef9625b9ebf0a561043.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_8aed8bf27e7a0ef9625b9ebf0a561043.jpg not downloaded yet
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_2bd25d706fd55c6ff5a7615082d2da8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_2bd25d706fd55c6ff5a7615082d2da8a.jpg not downloaded yet
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbaf6150>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_48e20e94790dd49e5e1cd0bce95153f8.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_48e20e94790dd49e5e1cd0bce95153f8.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbafa190>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_0adef5a12788432990cf6b072564041c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0adef5a12788432990cf6b072564041c.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-28 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05571255-8b87-538b-af8f-7daefb19c9bf with scrape type 1
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 05571255-8b87-538b-af8f-7daefb19c9bf
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_97eebcfbc39f60290dcf5af76e4a601f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_97eebcfbc39f60290dcf5af76e4a601f.jpg not downloaded yet
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_504fd5072bb1afc8415c766629a256d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_27c4c1b21a9f5d8385b04171211279d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0e8e73b19e50e22ef6283d1ea71e68c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_4fb4d1fb209fb41a158640e2933a87ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_e1efee1beec90c9532cc447374a8c5f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_e1efee1beec90c9532cc447374a8c5f6.jpg not downloaded yet
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_06031fbe714da37bba4860aa46ace71b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_06031fbe714da37bba4860aa46ace71b.jpg not downloaded yet
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_737307a834787c57e286d89d60166682.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_0ce36c7a81c57faef6edcc727cde1c22.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_0ce36c7a81c57faef6edcc727cde1c22.jpg not downloaded yet
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b7ad0>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_1c3ad3a22e92821b1ede0d1757b85a2d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_1c3ad3a22e92821b1ede0d1757b85a2d.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_2bd25d706fd55c6ff5a7615082d2da8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_e10bb05881672c48e32903f1a45182db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_e10bb05881672c48e32903f1a45182db.jpg not downloaded yet
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_97eebcfbc39f60290dcf5af76e4a601f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf0e5d0>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_504fd5072bb1afc8415c766629a256d8.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_504fd5072bb1afc8415c766629a256d8.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafaae90>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_27c4c1b21a9f5d8385b04171211279d4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_27c4c1b21a9f5d8385b04171211279d4.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb81d090>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_0e8e73b19e50e22ef6283d1ea71e68c5.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0e8e73b19e50e22ef6283d1ea71e68c5.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac4b090>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_4fb4d1fb209fb41a158640e2933a87ca.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_4fb4d1fb209fb41a158640e2933a87ca.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_191faaa6084c9ac3d07a5b1f153c72e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_191faaa6084c9ac3d07a5b1f153c72e8.jpg not downloaded yet
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_8aed8bf27e7a0ef9625b9ebf0a561043.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK34334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9b61d0>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_737307a834787c57e286d89d60166682.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_737307a834787c57e286d89d60166682.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb804a50>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_2bd25d706fd55c6ff5a7615082d2da8a.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_2bd25d706fd55c6ff5a7615082d2da8a.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9b85a50>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_97eebcfbc39f60290dcf5af76e4a601f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_97eebcfbc39f60290dcf5af76e4a601f.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05571255-8b87-538b-af8f-7daefb19c9bf
2026-03-28 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM92964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba510d0>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_8aed8bf27e7a0ef9625b9ebf0a561043.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_8aed8bf27e7a0ef9625b9ebf0a561043.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_0ce36c7a81c57faef6edcc727cde1c22.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_ceef47860ed47d61099d79fa5b41925d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_a9896ca6a8db8065d64831852b8638ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU56616> (referer: https://www.auto1.com/v1/car-details-view/WU56616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_e1efee1beec90c9532cc447374a8c5f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb892d50>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_0ce36c7a81c57faef6edcc727cde1c22.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_0ce36c7a81c57faef6edcc727cde1c22.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05571255-8b87-538b-af8f-7daefb19c9bf
2026-03-28 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_191faaa6084c9ac3d07a5b1f153c72e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9becd0>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_ceef47860ed47d61099d79fa5b41925d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_ceef47860ed47d61099d79fa5b41925d.jpg saved to cache
2026-03-28 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafa3d50>
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_a9896ca6a8db8065d64831852b8638ad.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_a9896ca6a8db8065d64831852b8638ad.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-28 12:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with scrape type 1
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_5b4a0bfc9fc192f6be0f4df9356924c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_5b4a0bfc9fc192f6be0f4df9356924c6.jpg not downloaded yet
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_e10bb05881672c48e32903f1a45182db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_06031fbe714da37bba4860aa46ace71b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_8b271666c2bd5d8ba0492a9706bc1353.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0aec9e352bad2a1e0484525b37f8cd8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_270cc750086e70419c69d50324810813.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_270cc750086e70419c69d50324810813.jpg not downloaded yet
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d99ebc10>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_e1efee1beec90c9532cc447374a8c5f6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_e1efee1beec90c9532cc447374a8c5f6.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8e1d50>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_191faaa6084c9ac3d07a5b1f153c72e8.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_191faaa6084c9ac3d07a5b1f153c72e8.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05571255-8b87-538b-af8f-7daefb19c9bf
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_816de5d18f86958e82c4f6199cb086ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_816de5d18f86958e82c4f6199cb086ec.jpg not downloaded yet
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT48510> (referer: https://www.auto1.com/v1/car-details-view/CT48510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK78214> (referer: https://www.auto1.com/v1/car-details-view/RK78214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE60245> (referer: https://www.auto1.com/v1/car-details-view/SE60245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_6913c917cbed3bf2cf0c7cdaf5b5efe4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_6913c917cbed3bf2cf0c7cdaf5b5efe4.jpg not downloaded yet
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf84a50>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_e10bb05881672c48e32903f1a45182db.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_e10bb05881672c48e32903f1a45182db.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05571255-8b87-538b-af8f-7daefb19c9bf
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb892350>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fb7%252F3fb7d16c1a46abaf84ed702e9cc235bb%252Fpa%252FTW61693_06031fbe714da37bba4860aa46ace71b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_06031fbe714da37bba4860aa46ace71b.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05571255-8b87-538b-af8f-7daefb19c9bf
2026-03-28 12:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05571255-8b87-538b-af8f-7daefb19c9bf, skipping ID generation
2026-03-28 12:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05571255-8b87-538b-af8f-7daefb19c9bf with scrape type 1
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05571255-8b87-538b-af8f-7daefb19c9bf sending to next pipeline
2026-03-28 12:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 05571255-8b87-538b-af8f-7daefb19c9bf, identifier: TW61693
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d99eaf90>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdb693081cd9114c8cf70f1a0a9f4a0%252Fpa%252FXR71865_8b271666c2bd5d8ba0492a9706bc1353.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_8b271666c2bd5d8ba0492a9706bc1353.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8c2eb86-b403-52aa-a592-971506686848
2026-03-28 12:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8c2eb86-b403-52aa-a592-971506686848, skipping ID generation
2026-03-28 12:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c2eb86-b403-52aa-a592-971506686848 with scrape type 1
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8c2eb86-b403-52aa-a592-971506686848 sending to next pipeline
2026-03-28 12:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8c2eb86-b403-52aa-a592-971506686848, identifier: XR71865
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf50b50>
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_0aec9e352bad2a1e0484525b37f8cd8c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0aec9e352bad2a1e0484525b37f8cd8c.jpg saved to cache
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_40da48e9542e04c929cf866786895878.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_40da48e9542e04c929cf866786895878.jpg not downloaded yet
2026-03-28 12:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-28 12:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-28 12:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693 to the API
2026-03-28 12:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_06031fbe714da37bba4860aa46ace71b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:33:56Z',
 'fuel_type': 'petrol',
 'id': '05571255-8b87-538b-af8f-7daefb19c9bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '36PSB6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW61693',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 174156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_97eebcfbc39f60290dcf5af76e4a601f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_06031fbe714da37bba4860aa46ace71b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_0ce36c7a81c57faef6edcc727cde1c22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_e10bb05881672c48e32903f1a45182db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05571255-8b87-538b-af8f-7daefb19c9bf/05571255-8b87-538b-af8f-7daefb19c9bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/b7/3fb7d16c1a46abaf84ed702e9cc235bb/pa/TW61693_191faaa6084c9ac3d07a5b1f153c72e8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One Minimalist',
 'transmission': 'manual',
 'trim': 'Minimalist',
 'year': 2011}
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [auto1.nl] INFO: Saving data for TW61693: {'created_time': 1774699245.220006, 'last_price_update_time': 1774699245.220015, 'auction_closing_time': 1774884836.0}
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TW61693') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-28 12:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865 to the API
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_8b271666c2bd5d8ba0492a9706bc1353.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:27:41Z',
 'fuel_type': 'electro',
 'id': 'e8c2eb86-b403-52aa-a592-971506686848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR71865',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 85102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_27c4c1b21a9f5d8385b04171211279d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_1c3ad3a22e92821b1ede0d1757b85a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_4fb4d1fb209fb41a158640e2933a87ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_504fd5072bb1afc8415c766629a256d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_8b271666c2bd5d8ba0492a9706bc1353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_2bd25d706fd55c6ff5a7615082d2da8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c2eb86-b403-52aa-a592-971506686848/e8c2eb86-b403-52aa-a592-971506686848_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdb693081cd9114c8cf70f1a0a9f4a0/pa/XR71865_e1efee1beec90c9532cc447374a8c5f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa electric drive 100 kW Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2020}
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [auto1.nl] INFO: Saving data for XR71865: {'created_time': 1774699245.717151, 'last_price_update_time': 1774699245.717161, 'auction_closing_time': 1774884461.0}
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XR71865') HTTP/1.1" 204 0
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_25314336f0e53bc53f3b9f76d071f272.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_86743b934124156fb050a7306a857be7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_3ec66586c00c6546c689cad2d6d3702c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_c365c7b8ed470e06073a0d5f2ec716b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF88780> (referer: https://www.auto1.com/v1/car-details-view/UF88780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF00808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE95402> (referer: https://www.auto1.com/v1/car-details-view/SE95402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-28 12:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f46fc1-87e1-5d13-bdf2-6214e122592d with scrape type 1
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 92f46fc1-87e1-5d13-bdf2-6214e122592d
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_2373c25e76bbaaf4610f8f361c320a65.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2373c25e76bbaaf4610f8f361c320a65.jpg not downloaded yet
2026-03-28 12:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-28 12:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e64196c-af08-5f22-8753-a45314fe44b5 with scrape type 1
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_6c8020b426ba8d530a7cb0d7c4509b4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_6c8020b426ba8d530a7cb0d7c4509b4c.jpg not downloaded yet
2026-03-28 12:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-28 12:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414e65a8-2fea-5288-b188-ea04bd4434a8 with scrape type 1
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_2043355005957427d3ad705017fe0726.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_2043355005957427d3ad705017fe0726.jpg not downloaded yet
2026-03-28 12:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD76922> (referer: https://www.auto1.com/v1/car-details-view/RD76922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG37971> (referer: https://www.auto1.com/v1/car-details-view/YG37971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_2fbcee6ac3b6c72aa09b6a977a73e9b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2fbcee6ac3b6c72aa09b6a977a73e9b6.jpg not downloaded yet
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_d06b40d5ff7f9bb7485447865e767303.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_d06b40d5ff7f9bb7485447865e767303.jpg not downloaded yet
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_196194a3078559257895515f23ad4717.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_196194a3078559257895515f23ad4717.jpg not downloaded yet
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_270cc750086e70419c69d50324810813.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_5b4a0bfc9fc192f6be0f4df9356924c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_816de5d18f86958e82c4f6199cb086ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_6913c917cbed3bf2cf0c7cdaf5b5efe4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_659ac0262ef99de42e9b141a624846e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_659ac0262ef99de42e9b141a624846e5.jpg not downloaded yet
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_bf7b4156cbf3506b6328f76f51d462ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bf7b4156cbf3506b6328f76f51d462ea.jpg not downloaded yet
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_3b2adac1b5673e0039e20e79965e2dd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_3b2adac1b5673e0039e20e79965e2dd6.jpg not downloaded yet
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_63eaf24e9d2f3d2918e17c11d0b0dc0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_dd15ae610988673a22f0b2d7b4c6131b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_a1dd920d4e2da9285d815d5ac3cd8f4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_a1dd920d4e2da9285d815d5ac3cd8f4d.jpg not downloaded yet
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_a514551a7129efeb5f71befeb877c506.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_a514551a7129efeb5f71befeb877c506.jpg not downloaded yet
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_0eb10b5b6437638b503132c58263335c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_0eb10b5b6437638b503132c58263335c.jpg not downloaded yet
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf20890>
2026-03-28 12:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_25314336f0e53bc53f3b9f76d071f272.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_25314336f0e53bc53f3b9f76d071f272.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac8a610>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_86743b934124156fb050a7306a857be7.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_86743b934124156fb050a7306a857be7.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac86050>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_3ec66586c00c6546c689cad2d6d3702c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_3ec66586c00c6546c689cad2d6d3702c.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac9ba10>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_c365c7b8ed470e06073a0d5f2ec716b3.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_c365c7b8ed470e06073a0d5f2ec716b3.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08939ddd-895c-578d-a6d4-0334c2d14419 with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_138a84b88feec4cacfec4ba277f7590b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_138a84b88feec4cacfec4ba277f7590b.jpg not downloaded yet
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7bff2c-839f-53a3-913a-7e1800065f59 with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_238657fdd41fc69dd09ef137c4c171c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_238657fdd41fc69dd09ef137c4c171c1.jpg not downloaded yet
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9a8b33a73f0c8ed63def5ff820adc05c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_64958c16c48b505c4719fefcffb965cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_64958c16c48b505c4719fefcffb965cb.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_49cc77e73e61011948e6e3b705949289.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_49cc77e73e61011948e6e3b705949289.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_d9ec9cc5c4015f6d6ee1cfd44a2f99cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_d9ec9cc5c4015f6d6ee1cfd44a2f99cf.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_269cbf7359850145962864b5cf8ecfb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_269cbf7359850145962864b5cf8ecfb3.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_52bc217fbe244759aeb16d275033c574.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_52bc217fbe244759aeb16d275033c574.jpg not downloaded yet
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_3ced1ff203216ab017572866b91c2994.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3ced1ff203216ab017572866b91c2994.jpg not downloaded yet
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cacd395-a1ad-5602-87f2-8ffb1476e019 with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4cacd395-a1ad-5602-87f2-8ffb1476e019
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_61eedde8c98afa2b518ec0c654ff895c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_61eedde8c98afa2b518ec0c654ff895c.jpg not downloaded yet
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_6c8020b426ba8d530a7cb0d7c4509b4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_faaa8c582b2b65ab0866a72855503444.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_2043355005957427d3ad705017fe0726.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_40da48e9542e04c929cf866786895878.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_f2be87b24499746642bb82b5578c141d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_196194a3078559257895515f23ad4717.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_bc09ef59c808bd287bc3e2fa72e32b27.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bc09ef59c808bd287bc3e2fa72e32b27.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_90c0686a22296843b4fba4040ab1086c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_90c0686a22296843b4fba4040ab1086c.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_a5dd997fae31e12c8dc58ad7bf2b0a8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a5dd997fae31e12c8dc58ad7bf2b0a8c.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_a3569fea30073b9fe87ba243edba0c4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_a3569fea30073b9fe87ba243edba0c4f.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_a9da27db0f3bb0a7a2cc9121a98ce7c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_a9da27db0f3bb0a7a2cc9121a98ce7c0.jpg not downloaded yet
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_902759aeec1d74f7716cfbb70c1fb20b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_902759aeec1d74f7716cfbb70c1fb20b.jpg not downloaded yet
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac87110>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_270cc750086e70419c69d50324810813.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_270cc750086e70419c69d50324810813.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec8b10>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_5b4a0bfc9fc192f6be0f4df9356924c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_5b4a0bfc9fc192f6be0f4df9356924c6.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec9a90>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_816de5d18f86958e82c4f6199cb086ec.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_816de5d18f86958e82c4f6199cb086ec.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec5d90>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_6913c917cbed3bf2cf0c7cdaf5b5efe4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_6913c917cbed3bf2cf0c7cdaf5b5efe4.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caed3a10>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa8%252Fc3a84c11db94d449b03c9859c2ef004e%252Fpa%252FNU66962_63eaf24e9d2f3d2918e17c11d0b0dc0c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_63eaf24e9d2f3d2918e17c11d0b0dc0c.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6803cc5-9c85-5100-a40c-c7330b413d80
2026-03-28 12:00:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6803cc5-9c85-5100-a40c-c7330b413d80, skipping ID generation
2026-03-28 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6803cc5-9c85-5100-a40c-c7330b413d80 with scrape type 1
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6803cc5-9c85-5100-a40c-c7330b413d80 sending to next pipeline
2026-03-28 12:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f6803cc5-9c85-5100-a40c-c7330b413d80, identifier: NU66962
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d99ada10>
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_dd15ae610988673a22f0b2d7b4c6131b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_dd15ae610988673a22f0b2d7b4c6131b.jpg saved to cache
2026-03-28 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_d06b40d5ff7f9bb7485447865e767303.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-28 12:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-28 12:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962 to the API
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_63eaf24e9d2f3d2918e17c11d0b0dc0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': 'f6803cc5-9c85-5100-a40c-c7330b413d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H893TK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU66962',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 159586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_63eaf24e9d2f3d2918e17c11d0b0dc0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0adef5a12788432990cf6b072564041c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_3ec66586c00c6546c689cad2d6d3702c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_48e20e94790dd49e5e1cd0bce95153f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_c365c7b8ed470e06073a0d5f2ec716b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2283438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_ceef47860ed47d61099d79fa5b41925d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2316939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_a9896ca6a8db8065d64831852b8638ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0e8e73b19e50e22ef6283d1ea71e68c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_0aec9e352bad2a1e0484525b37f8cd8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6803cc5-9c85-5100-a40c-c7330b413d80/f6803cc5-9c85-5100-a40c-c7330b413d80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/a8/c3a84c11db94d449b03c9859c2ef004e/pa/NU66962_8aed8bf27e7a0ef9625b9ebf0a561043.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 4x2 Active',
 'transmission': 'manual',
 'trim': '4x2 Active',
 'year': 2020}
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [auto1.nl] INFO: Saving data for NU66962: {'created_time': 1774699247.348726, 'last_price_update_time': 1774699247.348736, 'auction_closing_time': 1774882938.0}
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NU66962') HTTP/1.1" 204 0
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf22d90>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_9a8b33a73f0c8ed63def5ff820adc05c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9a8b33a73f0c8ed63def5ff820adc05c.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_238657fdd41fc69dd09ef137c4c171c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_4d69c6b9678e9611cf4ac6a4302f4b4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_4d69c6b9678e9611cf4ac6a4302f4b4f.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_5d0eb23f83bcf95c8e6a7ad79a629a3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_5d0eb23f83bcf95c8e6a7ad79a629a3c.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_a4a558aa0a305d87859a4a99bda05b01.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a4a558aa0a305d87859a4a99bda05b01.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_801c92d8fec47f9251494d24a1723c10.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_801c92d8fec47f9251494d24a1723c10.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_4584b000d3ba0e8f4a1817ce1e9c17b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_4584b000d3ba0e8f4a1817ce1e9c17b3.jpg not downloaded yet
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_8098d7d847c590696455b44fd89b2503.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_8098d7d847c590696455b44fd89b2503.jpg not downloaded yet
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_0eb10b5b6437638b503132c58263335c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2fbcee6ac3b6c72aa09b6a977a73e9b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2373c25e76bbaaf4610f8f361c320a65.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_3b2adac1b5673e0039e20e79965e2dd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bf7b4156cbf3506b6328f76f51d462ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB88576> (referer: https://www.auto1.com/v1/car-details-view/YB88576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC88699> (referer: https://www.auto1.com/v1/car-details-view/KC88699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae9bd50>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_6c8020b426ba8d530a7cb0d7c4509b4c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_6c8020b426ba8d530a7cb0d7c4509b4c.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeda610>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fe1%252F00e1fcf58f0fdbf92b9681cf0d47aea1%252Fpa%252FKL38892_faaa8c582b2b65ab0866a72855503444.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_faaa8c582b2b65ab0866a72855503444.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c62f588c-3746-59a5-a305-46f68cb734f2
2026-03-28 12:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c62f588c-3746-59a5-a305-46f68cb734f2, skipping ID generation
2026-03-28 12:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62f588c-3746-59a5-a305-46f68cb734f2 with scrape type 1
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c62f588c-3746-59a5-a305-46f68cb734f2 sending to next pipeline
2026-03-28 12:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c62f588c-3746-59a5-a305-46f68cb734f2, identifier: KL38892
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf239d0>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_2043355005957427d3ad705017fe0726.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_2043355005957427d3ad705017fe0726.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caea16d0>
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F0c%252F330c44b5fdac21f868c478c3e3f76779%252Fpa%252FWU56616_40da48e9542e04c929cf866786895878.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_40da48e9542e04c929cf866786895878.jpg saved to cache
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb
2026-03-28 12:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb, skipping ID generation
2026-03-28 12:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with scrape type 1
2026-03-28 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb sending to next pipeline
2026-03-28 12:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb, identifier: WU56616
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b7bd0>
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_f2be87b24499746642bb82b5578c141d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_f2be87b24499746642bb82b5578c141d.jpg saved to cache
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae41690>
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_196194a3078559257895515f23ad4717.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_196194a3078559257895515f23ad4717.jpg saved to cache
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_138a84b88feec4cacfec4ba277f7590b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_e7243ff1de985bb66a05f803e8588dbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_e7243ff1de985bb66a05f803e8588dbe.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_096f016b13bf514ed4e846ffb99f51d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_096f016b13bf514ed4e846ffb99f51d5.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_3bdd0a2c1ded7637dd6f6bdea77a98af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_3bdd0a2c1ded7637dd6f6bdea77a98af.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_815be9ac2919928295c13bd67a04e635.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_815be9ac2919928295c13bd67a04e635.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_b6296621d8b78ab649d3ed879f5e8274.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_b6296621d8b78ab649d3ed879f5e8274.jpg not downloaded yet
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_10109807bf81ce59062e4441dd0772df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_10109807bf81ce59062e4441dd0772df.jpg not downloaded yet
2026-03-28 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK34334> (referer: https://www.auto1.com/v1/car-details-view/JK34334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-28 12:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-28 12:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892 to the API
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_faaa8c582b2b65ab0866a72855503444.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:00:26Z',
 'fuel_type': 'electro',
 'id': 'c62f588c-3746-59a5-a305-46f68cb734f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL38892',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 169017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127982,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_faaa8c582b2b65ab0866a72855503444.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121372,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_d20146823e780ec8d596ebc6fdcd1453.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124357,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9a8b33a73f0c8ed63def5ff820adc05c.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119850,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_dd15ae610988673a22f0b2d7b4c6131b.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144015,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_9bc97c3075f49f4c9342814ec6bd3b40.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189844,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_86743b934124156fb050a7306a857be7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166050,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_25314336f0e53bc53f3b9f76d071f272.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c62f588c-3746-59a5-a305-46f68cb734f2/c62f588c-3746-59a5-a305-46f68cb734f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89772,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img00/e1/00e1fcf58f0fdbf92b9681cf0d47aea1/pa/KL38892_737307a834787c57e286d89d60166682.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Enyaq iV 80 Loft',
 'transmission': 'automatic',
 'trim': 'Loft',
 'year': 2022}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [auto1.nl] INFO: Saving data for KL38892: {'created_time': 1774699248.635205, 'last_price_update_time': 1774699248.635217, 'auction_closing_time': 1774882826.0}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KL38892') HTTP/1.1" 204 0
2026-03-28 12:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-28 12:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-28 12:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616 to the API
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_40da48e9542e04c929cf866786895878.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:05:28Z',
 'fuel_type': 'petrol',
 'id': '4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '92TRNS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU56616',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 183729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_5b4a0bfc9fc192f6be0f4df9356924c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_270cc750086e70419c69d50324810813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_816de5d18f86958e82c4f6199cb086ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_6913c917cbed3bf2cf0c7cdaf5b5efe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb/4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/0c/330c44b5fdac21f868c478c3e3f76779/pa/WU56616_40da48e9542e04c929cf866786895878.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-28 12:00:48 [auto1.nl] INFO: Saving data for WU56616: {'created_time': 1774699248.980939, 'last_price_update_time': 1774699248.980946, 'auction_closing_time': 1774883128.0}
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WU56616') HTTP/1.1" 204 0
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caee1090>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_d06b40d5ff7f9bb7485447865e767303.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_d06b40d5ff7f9bb7485447865e767303.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_a1dd920d4e2da9285d815d5ac3cd8f4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_a514551a7129efeb5f71befeb877c506.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae52f10>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_238657fdd41fc69dd09ef137c4c171c1.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_238657fdd41fc69dd09ef137c4c171c1.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_4a09ffd95690585b4cf0f15dcb03a3d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_4a09ffd95690585b4cf0f15dcb03a3d0.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_3d0a3e703abf109818bb93fccb49bcfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_3d0a3e703abf109818bb93fccb49bcfd.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_3413f2846dd2c6fe70d0337cb4087819.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3413f2846dd2c6fe70d0337cb4087819.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_5b1a5f2c9669da21e18174f452f331b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_5b1a5f2c9669da21e18174f452f331b5.jpg not downloaded yet
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM92964> (referer: https://www.auto1.com/v1/car-details-view/JM92964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad13510>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_0eb10b5b6437638b503132c58263335c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_0eb10b5b6437638b503132c58263335c.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad73e10>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_2fbcee6ac3b6c72aa09b6a977a73e9b6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2fbcee6ac3b6c72aa09b6a977a73e9b6.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92f46fc1-87e1-5d13-bdf2-6214e122592d
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb96dfd0>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_2373c25e76bbaaf4610f8f361c320a65.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2373c25e76bbaaf4610f8f361c320a65.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92f46fc1-87e1-5d13-bdf2-6214e122592d
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad82090>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_3b2adac1b5673e0039e20e79965e2dd6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_3b2adac1b5673e0039e20e79965e2dd6.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad825d0>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_bf7b4156cbf3506b6328f76f51d462ea.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bf7b4156cbf3506b6328f76f51d462ea.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_66b403ccfcd1dc38d79688d8f8090f1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_66b403ccfcd1dc38d79688d8f8090f1a.jpg not downloaded yet
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b24f0d-13c4-59a9-9eef-98f364879240 with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e2b24f0d-13c4-59a9-9eef-98f364879240
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_66a3c9df21deb5d1db2cc7565e8a90f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_66a3c9df21deb5d1db2cc7565e8a90f2.jpg not downloaded yet
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_902759aeec1d74f7716cfbb70c1fb20b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_61eedde8c98afa2b518ec0c654ff895c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad736d0>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_138a84b88feec4cacfec4ba277f7590b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_138a84b88feec4cacfec4ba277f7590b.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413cc031-18a1-59e6-a153-6656c2207504 with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_ff875534d2cf85ac13d6788c267d60b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_ff875534d2cf85ac13d6788c267d60b9.jpg not downloaded yet
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a5dd997fae31e12c8dc58ad7bf2b0a8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_a3569fea30073b9fe87ba243edba0c4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_79b1b1d5faefe7fe180b4f43ad3f176d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_79b1b1d5faefe7fe180b4f43ad3f176d.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_7cb5b5f200ba44d4e2def9c0a3acf4dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_7cb5b5f200ba44d4e2def9c0a3acf4dc.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_ac9543970d22e6fab96d0df684be0467.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_ac9543970d22e6fab96d0df684be0467.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_8cf5548c8ce2e7d946b1b7d1d5cc8533.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8cf5548c8ce2e7d946b1b7d1d5cc8533.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_3e2a04072e6da91403ca6818f5f844f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_3e2a04072e6da91403ca6818f5f844f3.jpg not downloaded yet
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bc09ef59c808bd287bc3e2fa72e32b27.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_90c0686a22296843b4fba4040ab1086c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_e95eae94e678a9150848396eee4ff589.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_e95eae94e678a9150848396eee4ff589.jpg not downloaded yet
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac45290>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_a1dd920d4e2da9285d815d5ac3cd8f4d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_a1dd920d4e2da9285d815d5ac3cd8f4d.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92f46fc1-87e1-5d13-bdf2-6214e122592d
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caee6110>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_a514551a7129efeb5f71befeb877c506.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_a514551a7129efeb5f71befeb877c506.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-28 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with scrape type 1
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_9dc9e8e2762c54aa198b0a5e7ff9ef29.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9dc9e8e2762c54aa198b0a5e7ff9ef29.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_338667e26e3166ed840b88888d89ed63.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_338667e26e3166ed840b88888d89ed63.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_368fdd0658d32a4edd2389da2a63c893.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_368fdd0658d32a4edd2389da2a63c893.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_8dcc64279ca5d338fe32455a0bed9575.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8dcc64279ca5d338fe32455a0bed9575.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_f1b9a229a8096a02a50222e19972ef30.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f1b9a229a8096a02a50222e19972ef30.jpg not downloaded yet
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_4584b000d3ba0e8f4a1817ce1e9c17b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_8098d7d847c590696455b44fd89b2503.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_3de25d578c9ed7f0fa658c48577f8171.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_3de25d578c9ed7f0fa658c48577f8171.jpg not downloaded yet
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_00506afd16d11ecf1cb556322b747282.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_00506afd16d11ecf1cb556322b747282.jpg not downloaded yet
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9cc5f50>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_902759aeec1d74f7716cfbb70c1fb20b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_902759aeec1d74f7716cfbb70c1fb20b.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cacd395-a1ad-5602-87f2-8ffb1476e019
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b6bd0>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_61eedde8c98afa2b518ec0c654ff895c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_61eedde8c98afa2b518ec0c654ff895c.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cacd395-a1ad-5602-87f2-8ffb1476e019
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbaf92d0>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_a5dd997fae31e12c8dc58ad7bf2b0a8c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a5dd997fae31e12c8dc58ad7bf2b0a8c.jpg saved to cache
2026-03-28 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8f5fd0>
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_a3569fea30073b9fe87ba243edba0c4f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_a3569fea30073b9fe87ba243edba0c4f.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_801c92d8fec47f9251494d24a1723c10.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a4a558aa0a305d87859a4a99bda05b01.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_30a73d15bc6526bec63f970758347396.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_30a73d15bc6526bec63f970758347396.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_34ac658e739a88745720ecb59f6130a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_34ac658e739a88745720ecb59f6130a2.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_45cb9dca46f9e68d5149df8a0420648e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_45cb9dca46f9e68d5149df8a0420648e.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_f3d36fb6a034cf17ce2977d66eed8ca6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f3d36fb6a034cf17ce2977d66eed8ca6.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf52410>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_bc09ef59c808bd287bc3e2fa72e32b27.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bc09ef59c808bd287bc3e2fa72e32b27.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbc4a90>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_90c0686a22296843b4fba4040ab1086c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_90c0686a22296843b4fba4040ab1086c.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_f2ce505a09e1481359e341b42b5c4cff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_f2ce505a09e1481359e341b42b5c4cff.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_25ceaf4ca8eb3e8a6a043bac970efd62.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_25ceaf4ca8eb3e8a6a043bac970efd62.jpg not downloaded yet
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_4d69c6b9678e9611cf4ac6a4302f4b4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_a7a0dc01e64cb63b373ce58c317d6c39.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a7a0dc01e64cb63b373ce58c317d6c39.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_41bd8c5e112b4f79c1d3ef2ffa99c925.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_41bd8c5e112b4f79c1d3ef2ffa99c925.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_aab7d9cc7903282034594a71951cba68.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_aab7d9cc7903282034594a71951cba68.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_0417d6be2b03fd51f2c38e43d03c6054.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_0417d6be2b03fd51f2c38e43d03c6054.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf8c490>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_4584b000d3ba0e8f4a1817ce1e9c17b3.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_4584b000d3ba0e8f4a1817ce1e9c17b3.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caccb690>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_8098d7d847c590696455b44fd89b2503.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_8098d7d847c590696455b44fd89b2503.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cacd395-a1ad-5602-87f2-8ffb1476e019
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_5d0eb23f83bcf95c8e6a7ad79a629a3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_75be502c222616bf2369c2295b7633b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_75be502c222616bf2369c2295b7633b0.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_469092cdc461f96db75e8f14fc71a1da.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_469092cdc461f96db75e8f14fc71a1da.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae1c850>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_801c92d8fec47f9251494d24a1723c10.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_801c92d8fec47f9251494d24a1723c10.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caca1b10>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_a4a558aa0a305d87859a4a99bda05b01.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a4a558aa0a305d87859a4a99bda05b01.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_10109807bf81ce59062e4441dd0772df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_66a3c9df21deb5d1db2cc7565e8a90f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_6dd585d4b21af61dc1c7c844c80bb117.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_6dd585d4b21af61dc1c7c844c80bb117.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_779011c18fd30543b1a44e2d5bda28db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_779011c18fd30543b1a44e2d5bda28db.jpg not downloaded yet
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_815be9ac2919928295c13bd67a04e635.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_1690e2843a35a42f76346cd358683c2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_1690e2843a35a42f76346cd358683c2c.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_67cb132e8020b2d31687cacd2d4d47a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_67cb132e8020b2d31687cacd2d4d47a6.jpg not downloaded yet
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF00808> (referer: https://www.auto1.com/v1/car-details-view/LF00808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cace0090>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_4d69c6b9678e9611cf4ac6a4302f4b4f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_4d69c6b9678e9611cf4ac6a4302f4b4f.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_66b403ccfcd1dc38d79688d8f8090f1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_13524b429a8a8b57fcdffd649e04ff41.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_13524b429a8a8b57fcdffd649e04ff41.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_bfcb6d0f404d2400085ac3dadf48f651.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_bfcb6d0f404d2400085ac3dadf48f651.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_f155b7694a601fe75b6b7e86da092cd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_f155b7694a601fe75b6b7e86da092cd9.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad139d0>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_5d0eb23f83bcf95c8e6a7ad79a629a3c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_5d0eb23f83bcf95c8e6a7ad79a629a3c.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_a0fa7ac0e7eb3ba496a5239ab86236af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_a0fa7ac0e7eb3ba496a5239ab86236af.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba73c10>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_10109807bf81ce59062e4441dd0772df.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_10109807bf81ce59062e4441dd0772df.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cacd395-a1ad-5602-87f2-8ffb1476e019
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacc3c90>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_66a3c9df21deb5d1db2cc7565e8a90f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_66a3c9df21deb5d1db2cc7565e8a90f2.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2b24f0d-13c4-59a9-9eef-98f364879240
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_b67eccc3c30f3b431fddd4a3574bdf4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_b67eccc3c30f3b431fddd4a3574bdf4b.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_a2fe239bd25327fa0f08dee0387b7de6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_a2fe239bd25327fa0f08dee0387b7de6.jpg not downloaded yet
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_ab6e3294e98e1a94e1d0388908dc006a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_ab6e3294e98e1a94e1d0388908dc006a.jpg not downloaded yet
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caca4090>
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_815be9ac2919928295c13bd67a04e635.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_815be9ac2919928295c13bd67a04e635.jpg saved to cache
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-28 12:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64a4567-874e-5e91-8545-53bd59ed3bcf with scrape type 1
2026-03-28 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a64a4567-874e-5e91-8545-53bd59ed3bcf
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_f4019045d560da721396709b9dddb102.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_f4019045d560da721396709b9dddb102.jpg not downloaded yet
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_e95eae94e678a9150848396eee4ff589.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f1b9a229a8096a02a50222e19972ef30.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_5798c611cc6f961606d252b041b6e8bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_5798c611cc6f961606d252b041b6e8bf.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_e7915877bd226d42b6f0008168fc91a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_e7915877bd226d42b6f0008168fc91a3.jpg not downloaded yet
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacd7f90>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_66b403ccfcd1dc38d79688d8f8090f1a.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_66b403ccfcd1dc38d79688d8f8090f1a.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_5b1a5f2c9669da21e18174f452f331b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_1ebf4257adde17329f40a46caeff5924.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_1ebf4257adde17329f40a46caeff5924.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_5c1bf0d14e4a39a795b580a7de4cd5cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_5c1bf0d14e4a39a795b580a7de4cd5cc.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_6b17971014c1e6d7895113de3ad03b99.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_6b17971014c1e6d7895113de3ad03b99.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_82efd611b6925142af141a5b9bf3ea5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_82efd611b6925142af141a5b9bf3ea5e.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_dfbb88e32831bb0f2881b9a4e2bb0517.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_dfbb88e32831bb0f2881b9a4e2bb0517.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_9424a5243d1989720b6e90c37e899e02.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9424a5243d1989720b6e90c37e899e02.jpg not downloaded yet
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_fad95d54a3d931d6a0709ccea851d5c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_fad95d54a3d931d6a0709ccea851d5c4.jpg not downloaded yet
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9109d0>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_e95eae94e678a9150848396eee4ff589.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_e95eae94e678a9150848396eee4ff589.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae66490>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_f1b9a229a8096a02a50222e19972ef30.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f1b9a229a8096a02a50222e19972ef30.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2b24f0d-13c4-59a9-9eef-98f364879240
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_46771f37439e3659a4e9150677c8fa2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_46771f37439e3659a4e9150677c8fa2f.jpg not downloaded yet
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b0b10>
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc1049955ee6cf962ce1e9fe5882667be%252Fpa%252FYG37971_5b1a5f2c9669da21e18174f452f331b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_5b1a5f2c9669da21e18174f452f331b5.jpg saved to cache
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cacd395-a1ad-5602-87f2-8ffb1476e019
2026-03-28 12:00:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cacd395-a1ad-5602-87f2-8ffb1476e019, skipping ID generation
2026-03-28 12:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cacd395-a1ad-5602-87f2-8ffb1476e019 with scrape type 1
2026-03-28 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cacd395-a1ad-5602-87f2-8ffb1476e019 sending to next pipeline
2026-03-28 12:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4cacd395-a1ad-5602-87f2-8ffb1476e019, identifier: YG37971
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f3d36fb6a034cf17ce2977d66eed8ca6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8dcc64279ca5d338fe32455a0bed9575.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-28 12:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-28 12:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971 to the API
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_5b1a5f2c9669da21e18174f452f331b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 223,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.3L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:57:09Z',
 'fuel_type': 'petrol',
 'id': '4cacd395-a1ad-5602-87f2-8ffb1476e019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '46ZLLH',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG37971',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 343295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_61eedde8c98afa2b518ec0c654ff895c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_902759aeec1d74f7716cfbb70c1fb20b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_8098d7d847c590696455b44fd89b2503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_10109807bf81ce59062e4441dd0772df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cacd395-a1ad-5602-87f2-8ffb1476e019/4cacd395-a1ad-5602-87f2-8ffb1476e019_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c1049955ee6cf962ce1e9fe5882667be/pa/YG37971_5b1a5f2c9669da21e18174f452f331b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.3 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2008}
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-28 12:00:52 [auto1.nl] INFO: Saving data for YG37971: {'created_time': 1774699252.077458, 'last_price_update_time': 1774699252.077468, 'auction_closing_time': 1774886229.0}
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YG37971') HTTP/1.1" 204 0
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_25ceaf4ca8eb3e8a6a043bac970efd62.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad641d0>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_f3d36fb6a034cf17ce2977d66eed8ca6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f3d36fb6a034cf17ce2977d66eed8ca6.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2b24f0d-13c4-59a9-9eef-98f364879240
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2e6180050>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_8dcc64279ca5d338fe32455a0bed9575.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8dcc64279ca5d338fe32455a0bed9575.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3ced1ff203216ab017572866b91c2994.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_a9da27db0f3bb0a7a2cc9121a98ce7c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_b6296621d8b78ab649d3ed879f5e8274.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_ff875534d2cf85ac13d6788c267d60b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad6dc90>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_25ceaf4ca8eb3e8a6a043bac970efd62.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_25ceaf4ca8eb3e8a6a043bac970efd62.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9dc9e8e2762c54aa198b0a5e7ff9ef29.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbace750>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_3ced1ff203216ab017572866b91c2994.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3ced1ff203216ab017572866b91c2994.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_469092cdc461f96db75e8f14fc71a1da.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_75be502c222616bf2369c2295b7633b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae67890>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_a9da27db0f3bb0a7a2cc9121a98ce7c0.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_a9da27db0f3bb0a7a2cc9121a98ce7c0.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_0417d6be2b03fd51f2c38e43d03c6054.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_fad95d54a3d931d6a0709ccea851d5c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad6ce10>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_b6296621d8b78ab649d3ed879f5e8274.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_b6296621d8b78ab649d3ed879f5e8274.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbacee50>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_ff875534d2cf85ac13d6788c267d60b9.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_ff875534d2cf85ac13d6788c267d60b9.jpg saved to cache
2026-03-28 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbee910>
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_9dc9e8e2762c54aa198b0a5e7ff9ef29.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9dc9e8e2762c54aa198b0a5e7ff9ef29.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_46771f37439e3659a4e9150677c8fa2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d88c4890>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_469092cdc461f96db75e8f14fc71a1da.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_469092cdc461f96db75e8f14fc71a1da.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb992710>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_75be502c222616bf2369c2295b7633b0.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_75be502c222616bf2369c2295b7633b0.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9424a5243d1989720b6e90c37e899e02.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad2c610>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_0417d6be2b03fd51f2c38e43d03c6054.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_0417d6be2b03fd51f2c38e43d03c6054.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2b24f0d-13c4-59a9-9eef-98f364879240
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeece10>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_fad95d54a3d931d6a0709ccea851d5c4.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_fad95d54a3d931d6a0709ccea851d5c4.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a64a4567-874e-5e91-8545-53bd59ed3bcf
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_dfbb88e32831bb0f2881b9a4e2bb0517.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae03950>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_46771f37439e3659a4e9150677c8fa2f.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_46771f37439e3659a4e9150677c8fa2f.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a64a4567-874e-5e91-8545-53bd59ed3bcf
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_5c1bf0d14e4a39a795b580a7de4cd5cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae01690>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_9424a5243d1989720b6e90c37e899e02.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9424a5243d1989720b6e90c37e899e02.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_6dd585d4b21af61dc1c7c844c80bb117.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_779011c18fd30543b1a44e2d5bda28db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b2810>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_dfbb88e32831bb0f2881b9a4e2bb0517.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_dfbb88e32831bb0f2881b9a4e2bb0517.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a64a4567-874e-5e91-8545-53bd59ed3bcf
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_82efd611b6925142af141a5b9bf3ea5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_a2fe239bd25327fa0f08dee0387b7de6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb992f10>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_5c1bf0d14e4a39a795b580a7de4cd5cc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_5c1bf0d14e4a39a795b580a7de4cd5cc.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a64a4567-874e-5e91-8545-53bd59ed3bcf
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_b67eccc3c30f3b431fddd4a3574bdf4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_f4019045d560da721396709b9dddb102.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_e7915877bd226d42b6f0008168fc91a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba71c90>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_6dd585d4b21af61dc1c7c844c80bb117.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_6dd585d4b21af61dc1c7c844c80bb117.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_6b17971014c1e6d7895113de3ad03b99.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_1ebf4257adde17329f40a46caeff5924.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeed810>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_779011c18fd30543b1a44e2d5bda28db.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_779011c18fd30543b1a44e2d5bda28db.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae7dcd0>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_82efd611b6925142af141a5b9bf3ea5e.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_82efd611b6925142af141a5b9bf3ea5e.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac1f550>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_a2fe239bd25327fa0f08dee0387b7de6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_a2fe239bd25327fa0f08dee0387b7de6.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb97bed0>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_b67eccc3c30f3b431fddd4a3574bdf4b.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_b67eccc3c30f3b431fddd4a3574bdf4b.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae7e310>
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f94909b688c2e541d759d4b0ff19b1b%252Fpa%252FLF00808_f4019045d560da721396709b9dddb102.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_f4019045d560da721396709b9dddb102.jpg saved to cache
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a64a4567-874e-5e91-8545-53bd59ed3bcf
2026-03-28 12:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a64a4567-874e-5e91-8545-53bd59ed3bcf, skipping ID generation
2026-03-28 12:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64a4567-874e-5e91-8545-53bd59ed3bcf with scrape type 1
2026-03-28 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a64a4567-874e-5e91-8545-53bd59ed3bcf sending to next pipeline
2026-03-28 12:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a64a4567-874e-5e91-8545-53bd59ed3bcf, identifier: LF00808
2026-03-28 12:00:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba242d0>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_e7915877bd226d42b6f0008168fc91a3.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_e7915877bd226d42b6f0008168fc91a3.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-28 12:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-28 12:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808 to the API
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_f4019045d560da721396709b9dddb102.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'petrol',
 'id': 'a64a4567-874e-5e91-8545-53bd59ed3bcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '63ZNXH',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF00808',
 'listing': 'auction',
 'location': 'NL, Ede',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 173258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_f4019045d560da721396709b9dddb102.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_5c1bf0d14e4a39a795b580a7de4cd5cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_dfbb88e32831bb0f2881b9a4e2bb0517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_fad95d54a3d931d6a0709ccea851d5c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a4567-874e-5e91-8545-53bd59ed3bcf/a64a4567-874e-5e91-8545-53bd59ed3bcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f94909b688c2e541d759d4b0ff19b1b/pa/LF00808_46771f37439e3659a4e9150677c8fa2f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2008}
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-28 12:00:54 [auto1.nl] INFO: Saving data for LF00808: {'created_time': 1774699254.772537, 'last_price_update_time': 1774699254.772548, 'auction_closing_time': 1774882995.0}
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF00808') HTTP/1.1" 204 0
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_ab6e3294e98e1a94e1d0388908dc006a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_67cb132e8020b2d31687cacd2d4d47a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_1690e2843a35a42f76346cd358683c2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba27a10>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_6b17971014c1e6d7895113de3ad03b99.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_6b17971014c1e6d7895113de3ad03b99.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafb5250>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_1ebf4257adde17329f40a46caeff5924.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_1ebf4257adde17329f40a46caeff5924.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba1f010>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_ab6e3294e98e1a94e1d0388908dc006a.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_ab6e3294e98e1a94e1d0388908dc006a.jpg saved to cache
2026-03-28 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba1eed0>
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_67cb132e8020b2d31687cacd2d4d47a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_67cb132e8020b2d31687cacd2d4d47a6.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9a0a1d0>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_1690e2843a35a42f76346cd358683c2c.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_1690e2843a35a42f76346cd358683c2c.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_aab7d9cc7903282034594a71951cba68.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_5798c611cc6f961606d252b041b6e8bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_41bd8c5e112b4f79c1d3ef2ffa99c925.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_a0fa7ac0e7eb3ba496a5239ab86236af.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_13524b429a8a8b57fcdffd649e04ff41.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_bfcb6d0f404d2400085ac3dadf48f651.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_f155b7694a601fe75b6b7e86da092cd9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a7a0dc01e64cb63b373ce58c317d6c39.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba9e890>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_aab7d9cc7903282034594a71951cba68.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_aab7d9cc7903282034594a71951cba68.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba2db50>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_5798c611cc6f961606d252b041b6e8bf.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_5798c611cc6f961606d252b041b6e8bf.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacb6d10>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_41bd8c5e112b4f79c1d3ef2ffa99c925.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_41bd8c5e112b4f79c1d3ef2ffa99c925.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae7c110>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_a0fa7ac0e7eb3ba496a5239ab86236af.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_a0fa7ac0e7eb3ba496a5239ab86236af.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb988590>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_13524b429a8a8b57fcdffd649e04ff41.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_13524b429a8a8b57fcdffd649e04ff41.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae64c10>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_bfcb6d0f404d2400085ac3dadf48f651.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_bfcb6d0f404d2400085ac3dadf48f651.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caed85d0>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_f155b7694a601fe75b6b7e86da092cd9.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_f155b7694a601fe75b6b7e86da092cd9.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_30a73d15bc6526bec63f970758347396.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_45cb9dca46f9e68d5149df8a0420648e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_34ac658e739a88745720ecb59f6130a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_f2ce505a09e1481359e341b42b5c4cff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_338667e26e3166ed840b88888d89ed63.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8af690>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_a7a0dc01e64cb63b373ce58c317d6c39.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a7a0dc01e64cb63b373ce58c317d6c39.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_3e2a04072e6da91403ca6818f5f844f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_368fdd0658d32a4edd2389da2a63c893.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_3de25d578c9ed7f0fa658c48577f8171.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_00506afd16d11ecf1cb556322b747282.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9dc190>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_30a73d15bc6526bec63f970758347396.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_30a73d15bc6526bec63f970758347396.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_3d0a3e703abf109818bb93fccb49bcfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad6e050>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_45cb9dca46f9e68d5149df8a0420648e.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_45cb9dca46f9e68d5149df8a0420648e.jpg saved to cache
2026-03-28 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafc1550>
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_34ac658e739a88745720ecb59f6130a2.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_34ac658e739a88745720ecb59f6130a2.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae0a4d0>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_f2ce505a09e1481359e341b42b5c4cff.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_f2ce505a09e1481359e341b42b5c4cff.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba2f810>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_338667e26e3166ed840b88888d89ed63.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_338667e26e3166ed840b88888d89ed63.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_7cb5b5f200ba44d4e2def9c0a3acf4dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_ac9543970d22e6fab96d0df684be0467.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_4a09ffd95690585b4cf0f15dcb03a3d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_096f016b13bf514ed4e846ffb99f51d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_3bdd0a2c1ded7637dd6f6bdea77a98af.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8cf5548c8ce2e7d946b1b7d1d5cc8533.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_79b1b1d5faefe7fe180b4f43ad3f176d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae09310>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443dfb83d89f681c6e232e4a5121b85%252Fpa%252FKC88699_3e2a04072e6da91403ca6818f5f844f3.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_3e2a04072e6da91403ca6818f5f844f3.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2b24f0d-13c4-59a9-9eef-98f364879240
2026-03-28 12:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2b24f0d-13c4-59a9-9eef-98f364879240, skipping ID generation
2026-03-28 12:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b24f0d-13c4-59a9-9eef-98f364879240 with scrape type 1
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2b24f0d-13c4-59a9-9eef-98f364879240 sending to next pipeline
2026-03-28 12:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e2b24f0d-13c4-59a9-9eef-98f364879240, identifier: KC88699
2026-03-28 12:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbef210>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_368fdd0658d32a4edd2389da2a63c893.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_368fdd0658d32a4edd2389da2a63c893.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacc2e50>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fe7%252F43e7cde024b8ac1eb7cd3fd28bfb553e%252Fpa%252FJK34334_3de25d578c9ed7f0fa658c48577f8171.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_3de25d578c9ed7f0fa658c48577f8171.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 413cc031-18a1-59e6-a153-6656c2207504
2026-03-28 12:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 413cc031-18a1-59e6-a153-6656c2207504, skipping ID generation
2026-03-28 12:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413cc031-18a1-59e6-a153-6656c2207504 with scrape type 1
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 413cc031-18a1-59e6-a153-6656c2207504 sending to next pipeline
2026-03-28 12:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 413cc031-18a1-59e6-a153-6656c2207504, identifier: JK34334
2026-03-28 12:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae09f10>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd2%252Ff1d2efbe993180fba95a0a5ead5c3ad8%252Fpa%252FJM92964_00506afd16d11ecf1cb556322b747282.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_00506afd16d11ecf1cb556322b747282.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e
2026-03-28 12:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e, skipping ID generation
2026-03-28 12:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with scrape type 1
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e sending to next pipeline
2026-03-28 12:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e, identifier: JM92964
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac9f890>
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_3d0a3e703abf109818bb93fccb49bcfd.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_3d0a3e703abf109818bb93fccb49bcfd.jpg saved to cache
2026-03-28 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-28 12:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-28 12:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699 to the API
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_3e2a04072e6da91403ca6818f5f844f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:50:50Z',
 'fuel_type': 'petrol',
 'id': 'e2b24f0d-13c4-59a9-9eef-98f364879240',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '88TJPV',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC88699',
 'listing': 'auction',
 'location': 'NL, Vianen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 185215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_66a3c9df21deb5d1db2cc7565e8a90f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_3e2a04072e6da91403ca6818f5f844f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f1b9a229a8096a02a50222e19972ef30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_f3d36fb6a034cf17ce2977d66eed8ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b24f0d-13c4-59a9-9eef-98f364879240/e2b24f0d-13c4-59a9-9eef-98f364879240_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443dfb83d89f681c6e232e4a5121b85/pa/KC88699_0417d6be2b03fd51f2c38e43d03c6054.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2006}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-28 12:00:57 [auto1.nl] INFO: Saving data for KC88699: {'created_time': 1774699257.31802, 'last_price_update_time': 1774699257.318031, 'auction_closing_time': 1774885850.0}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC88699') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-28 12:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-28 12:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334 to the API
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_3de25d578c9ed7f0fa658c48577f8171.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:23:00Z',
 'fuel_type': 'petrol',
 'id': '413cc031-18a1-59e6-a153-6656c2207504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '76RZV4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK34334',
 'listing': 'auction',
 'location': 'NL, Koog aan de Zaan',
 'make': 'BMW',
 'model': '5er',
 'odometer': 182947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609727,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_ff875534d2cf85ac13d6788c267d60b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_e95eae94e678a9150848396eee4ff589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_3de25d578c9ed7f0fa658c48577f8171.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_f2ce505a09e1481359e341b42b5c4cff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_75be502c222616bf2369c2295b7633b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_1690e2843a35a42f76346cd358683c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656272,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_bfcb6d0f404d2400085ac3dadf48f651.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707472,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_b67eccc3c30f3b431fddd4a3574bdf4b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_5798c611cc6f961606d252b041b6e8bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_413cc031-18a1-59e6-a153-6656c2207504/413cc031-18a1-59e6-a153-6656c2207504_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/e7/43e7cde024b8ac1eb7cd3fd28bfb553e/pa/JK34334_6b17971014c1e6d7895113de3ad03b99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-28 12:00:57 [auto1.nl] INFO: Saving data for JK34334: {'created_time': 1774699257.77111, 'last_price_update_time': 1774699257.771119, 'auction_closing_time': 1774884180.0}
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK34334') HTTP/1.1" 204 0
2026-03-28 12:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 12:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-28 12:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964 to the API
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_00506afd16d11ecf1cb556322b747282.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'petrol',
 'id': '73bdbdbb-1e7d-50a7-b51e-883cbdba877e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NG868H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM92964',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 187016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9dc9e8e2762c54aa198b0a5e7ff9ef29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852861,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_00506afd16d11ecf1cb556322b747282.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_25ceaf4ca8eb3e8a6a043bac970efd62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_469092cdc461f96db75e8f14fc71a1da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_67cb132e8020b2d31687cacd2d4d47a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2723225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_f155b7694a601fe75b6b7e86da092cd9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_a2fe239bd25327fa0f08dee0387b7de6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_e7915877bd226d42b6f0008168fc91a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_82efd611b6925142af141a5b9bf3ea5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bdbdbb-1e7d-50a7-b51e-883cbdba877e/73bdbdbb-1e7d-50a7-b51e-883cbdba877e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d2/f1d2efbe993180fba95a0a5ead5c3ad8/pa/JM92964_9424a5243d1989720b6e90c37e899e02.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Seat Mii 1.0 FR-Line',
 'transmission': 'manual',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-28 12:00:58 [auto1.nl] INFO: Saving data for JM92964: {'created_time': 1774699258.401759, 'last_price_update_time': 1774699258.401768, 'auction_closing_time': 1774884721.0}
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM92964') HTTP/1.1" 204 0
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_e7243ff1de985bb66a05f803e8588dbe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_52bc217fbe244759aeb16d275033c574.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_49cc77e73e61011948e6e3b705949289.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_d9ec9cc5c4015f6d6ee1cfd44a2f99cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_269cbf7359850145962864b5cf8ecfb3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caca56d0>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_7cb5b5f200ba44d4e2def9c0a3acf4dc.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_7cb5b5f200ba44d4e2def9c0a3acf4dc.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba73b90>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_ac9543970d22e6fab96d0df684be0467.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_ac9543970d22e6fab96d0df684be0467.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba26990>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_4a09ffd95690585b4cf0f15dcb03a3d0.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_4a09ffd95690585b4cf0f15dcb03a3d0.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad668d0>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_096f016b13bf514ed4e846ffb99f51d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_096f016b13bf514ed4e846ffb99f51d5.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac1db10>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_3bdd0a2c1ded7637dd6f6bdea77a98af.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_3bdd0a2c1ded7637dd6f6bdea77a98af.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae08850>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fd0%252F07d08b95e1dac834ebd1027775f6cb1b%252Fpa%252FYB88576_8cf5548c8ce2e7d946b1b7d1d5cc8533.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8cf5548c8ce2e7d946b1b7d1d5cc8533.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e
2026-03-28 12:00:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e, skipping ID generation
2026-03-28 12:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with scrape type 1
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e sending to next pipeline
2026-03-28 12:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e, identifier: YB88576
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb918f10>
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_79b1b1d5faefe7fe180b4f43ad3f176d.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_79b1b1d5faefe7fe180b4f43ad3f176d.jpg saved to cache
2026-03-28 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-28 12:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-28 12:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576 to the API
2026-03-28 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8cf5548c8ce2e7d946b1b7d1d5cc8533.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:13:27Z',
 'fuel_type': 'diesel',
 'id': 'd2d8fe64-2e0f-5774-af0e-e5b13e499b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'VLZ33D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB88576',
 'listing': 'auction',
 'location': 'NL, Ede',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 143378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_66b403ccfcd1dc38d79688d8f8090f1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8cf5548c8ce2e7d946b1b7d1d5cc8533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_8dcc64279ca5d338fe32455a0bed9575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_45cb9dca46f9e68d5149df8a0420648e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_aab7d9cc7903282034594a71951cba68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_779011c18fd30543b1a44e2d5bda28db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2369441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_13524b429a8a8b57fcdffd649e04ff41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377295,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_a0fa7ac0e7eb3ba496a5239ab86236af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_ab6e3294e98e1a94e1d0388908dc006a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d8fe64-2e0f-5774-af0e-e5b13e499b1e/d2d8fe64-2e0f-5774-af0e-e5b13e499b1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/d0/07d08b95e1dac834ebd1027775f6cb1b/pa/YB88576_1ebf4257adde17329f40a46caeff5924.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'automatic',
 'trim': 'Club M',
 'year': 2021}
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-28 12:00:59 [auto1.nl] INFO: Saving data for YB88576: {'created_time': 1774699259.267465, 'last_price_update_time': 1774699259.267476, 'auction_closing_time': 1774883607.0}
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB88576') HTTP/1.1" 204 0
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbabb210>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_e7243ff1de985bb66a05f803e8588dbe.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_e7243ff1de985bb66a05f803e8588dbe.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbab8150>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F10%252F31108add5315e13f6aead33a7f4e4a6c%252Fpa%252FSE95402_52bc217fbe244759aeb16d275033c574.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_52bc217fbe244759aeb16d275033c574.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd7bff2c-839f-53a3-913a-7e1800065f59
2026-03-28 12:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd7bff2c-839f-53a3-913a-7e1800065f59, skipping ID generation
2026-03-28 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7bff2c-839f-53a3-913a-7e1800065f59 with scrape type 1
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd7bff2c-839f-53a3-913a-7e1800065f59 sending to next pipeline
2026-03-28 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd7bff2c-839f-53a3-913a-7e1800065f59, identifier: SE95402
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8f3390>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F2e%252F502ef068a2d826c3c1a1c1a665a59b73%252Fpa%252FRK78214_49cc77e73e61011948e6e3b705949289.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_49cc77e73e61011948e6e3b705949289.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e64196c-af08-5f22-8753-a45314fe44b5
2026-03-28 12:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e64196c-af08-5f22-8753-a45314fe44b5, skipping ID generation
2026-03-28 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e64196c-af08-5f22-8753-a45314fe44b5 with scrape type 1
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e64196c-af08-5f22-8753-a45314fe44b5 sending to next pipeline
2026-03-28 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9e64196c-af08-5f22-8753-a45314fe44b5, identifier: RK78214
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbab8cd0>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F05%252F8a05b37c55bf00f4b87c0dec2c6104bd%252Fpa%252FSE60245_d9ec9cc5c4015f6d6ee1cfd44a2f99cf.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_d9ec9cc5c4015f6d6ee1cfd44a2f99cf.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 414e65a8-2fea-5288-b188-ea04bd4434a8
2026-03-28 12:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 414e65a8-2fea-5288-b188-ea04bd4434a8, skipping ID generation
2026-03-28 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414e65a8-2fea-5288-b188-ea04bd4434a8 with scrape type 1
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 414e65a8-2fea-5288-b188-ea04bd4434a8 sending to next pipeline
2026-03-28 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 414e65a8-2fea-5288-b188-ea04bd4434a8, identifier: SE60245
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9ab5d0>
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3d0fb8da3fa98639487db9b34f6c3%252Fpa%252FUF88780_269cbf7359850145962864b5cf8ecfb3.jpg') HTTP/1.1" 204 0
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_269cbf7359850145962864b5cf8ecfb3.jpg saved to cache
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08939ddd-895c-578d-a6d4-0334c2d14419
2026-03-28 12:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08939ddd-895c-578d-a6d4-0334c2d14419, skipping ID generation
2026-03-28 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08939ddd-895c-578d-a6d4-0334c2d14419 with scrape type 1
2026-03-28 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08939ddd-895c-578d-a6d4-0334c2d14419 sending to next pipeline
2026-03-28 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08939ddd-895c-578d-a6d4-0334c2d14419, identifier: UF88780
2026-03-28 12:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-28 12:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-28 12:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402 to the API
2026-03-28 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_52bc217fbe244759aeb16d275033c574.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:58:22Z',
 'fuel_type': 'electro',
 'id': 'cd7bff2c-839f-53a3-913a-7e1800065f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE95402',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 151881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_238657fdd41fc69dd09ef137c4c171c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_52bc217fbe244759aeb16d275033c574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103391,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_a3569fea30073b9fe87ba243edba0c4f.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_801c92d8fec47f9251494d24a1723c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_815be9ac2919928295c13bd67a04e635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77189,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_3d0a3e703abf109818bb93fccb49bcfd.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd7bff2c-839f-53a3-913a-7e1800065f59/cd7bff2c-839f-53a3-913a-7e1800065f59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/10/31108add5315e13f6aead33a7f4e4a6c/pa/SE95402_7cb5b5f200ba44d4e2def9c0a3acf4dc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2023}
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-28 12:01:00 [auto1.nl] INFO: Saving data for SE95402: {'created_time': 1774699260.527998, 'last_price_update_time': 1774699260.528007, 'auction_closing_time': 1774886302.0}
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE95402') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-28 12:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-28 12:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214 to the API
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_49cc77e73e61011948e6e3b705949289.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:39:18Z',
 'fuel_type': 'electro',
 'id': '9e64196c-af08-5f22-8753-a45314fe44b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK78214',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 113999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104441,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_6c8020b426ba8d530a7cb0d7c4509b4c.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105546,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_d06b40d5ff7f9bb7485447865e767303.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107392,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bf7b4156cbf3506b6328f76f51d462ea.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100565,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_a514551a7129efeb5f71befeb877c506.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68190,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_49cc77e73e61011948e6e3b705949289.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96329,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_bc09ef59c808bd287bc3e2fa72e32b27.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_4d69c6b9678e9611cf4ac6a4302f4b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e64196c-af08-5f22-8753-a45314fe44b5/9e64196c-af08-5f22-8753-a45314fe44b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/2e/502ef068a2d826c3c1a1c1a665a59b73/pa/RK78214_e7243ff1de985bb66a05f803e8588dbe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Life Pro Performance',
 'transmission': 'automatic',
 'trim': 'Life Pro Performance',
 'year': 2021}
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-28 12:01:00 [auto1.nl] INFO: Saving data for RK78214: {'created_time': 1774699260.958371, 'last_price_update_time': 1774699260.958381, 'auction_closing_time': 1774885158.0}
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RK78214') HTTP/1.1" 204 0
2026-03-28 12:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-28 12:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-28 12:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245 to the API
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_d9ec9cc5c4015f6d6ee1cfd44a2f99cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:31:06Z',
 'fuel_type': 'electro',
 'id': '414e65a8-2fea-5288-b188-ea04bd4434a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE60245',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 171944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110558,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_2043355005957427d3ad705017fe0726.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_196194a3078559257895515f23ad4717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119737,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_3b2adac1b5673e0039e20e79965e2dd6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_0eb10b5b6437638b503132c58263335c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104739,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_d9ec9cc5c4015f6d6ee1cfd44a2f99cf.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_90c0686a22296843b4fba4040ab1086c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199785,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_5d0eb23f83bcf95c8e6a7ad79a629a3c.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414e65a8-2fea-5288-b188-ea04bd4434a8/414e65a8-2fea-5288-b188-ea04bd4434a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65317,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/05/8a05b37c55bf00f4b87c0dec2c6104bd/pa/SE60245_096f016b13bf514ed4e846ffb99f51d5.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Life Pro Performance',
 'transmission': 'automatic',
 'trim': 'Life Pro Performance',
 'year': 2021}
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-28 12:01:01 [auto1.nl] INFO: Saving data for SE60245: {'created_time': 1774699261.351577, 'last_price_update_time': 1774699261.351586, 'auction_closing_time': 1774884666.0}
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE60245') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-28 12:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-28 12:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780 to the API
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_269cbf7359850145962864b5cf8ecfb3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:44:30Z',
 'fuel_type': 'hybrid',
 'id': '08939ddd-895c-578d-a6d4-0334c2d14419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K-403-XL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF88780',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 60311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_138a84b88feec4cacfec4ba277f7590b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_269cbf7359850145962864b5cf8ecfb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a5dd997fae31e12c8dc58ad7bf2b0a8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a4a558aa0a305d87859a4a99bda05b01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_3bdd0a2c1ded7637dd6f6bdea77a98af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_4a09ffd95690585b4cf0f15dcb03a3d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_79b1b1d5faefe7fe180b4f43ad3f176d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_338667e26e3166ed840b88888d89ed63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_30a73d15bc6526bec63f970758347396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08939ddd-895c-578d-a6d4-0334c2d14419/08939ddd-895c-578d-a6d4-0334c2d14419_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3d0fb8da3fa98639487db9b34f6c3/pa/UF88780_a7a0dc01e64cb63b373ce58c317d6c39.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Smart 2WD',
 'transmission': 'automatic',
 'trim': 'Smart 2WD',
 'year': 2021}
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-28 12:01:01 [auto1.nl] INFO: Saving data for UF88780: {'created_time': 1774699261.697784, 'last_price_update_time': 1774699261.697793, 'auction_closing_time': 1774885470.0}
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF88780') HTTP/1.1" 204 0
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_64958c16c48b505c4719fefcffb965cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_92477f77643bc6402f7f1e42cf9822f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_659ac0262ef99de42e9b141a624846e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_1827d3d5557a6e0079703c774f2b0ae7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3413f2846dd2c6fe70d0337cb4087819.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_e2f91e71efbafbc28cd985ea0aa56058.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a484e6b5cad40f631410b8d52a51d473.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_6601216adc06908f94a1e9aa9ad98ce9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_dc33e7e927d7d72b2839c77111774ea5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caccb0d0>
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_64958c16c48b505c4719fefcffb965cb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_64958c16c48b505c4719fefcffb965cb.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92f46fc1-87e1-5d13-bdf2-6214e122592d
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_41fd0ae092a9f6051b67542a51c2d486.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_e85852f855cddc75ed33184fa547600b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacc8b90>
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_92477f77643bc6402f7f1e42cf9822f9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_92477f77643bc6402f7f1e42cf9822f9.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae4f010>
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff1%252F6cf1acab1dacb106972d7156748b2cce%252Fpa%252FCT48510_659ac0262ef99de42e9b141a624846e5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_659ac0262ef99de42e9b141a624846e5.jpg saved to cache
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92f46fc1-87e1-5d13-bdf2-6214e122592d
2026-03-28 12:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92f46fc1-87e1-5d13-bdf2-6214e122592d, skipping ID generation
2026-03-28 12:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f46fc1-87e1-5d13-bdf2-6214e122592d with scrape type 1
2026-03-28 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92f46fc1-87e1-5d13-bdf2-6214e122592d sending to next pipeline
2026-03-28 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 92f46fc1-87e1-5d13-bdf2-6214e122592d, identifier: CT48510
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf16f10>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_1827d3d5557a6e0079703c774f2b0ae7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_1827d3d5557a6e0079703c774f2b0ae7.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae867d0>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F1b%252F1d1b9f0546bd75167667287cf863d637%252Fpa%252FRD76922_3413f2846dd2c6fe70d0337cb4087819.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3413f2846dd2c6fe70d0337cb4087819.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba
2026-03-28 12:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba, skipping ID generation
2026-03-28 12:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with scrape type 1
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba sending to next pipeline
2026-03-28 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba, identifier: RD76922
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb98b090>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_e2f91e71efbafbc28cd985ea0aa56058.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_e2f91e71efbafbc28cd985ea0aa56058.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caccb3d0>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_a484e6b5cad40f631410b8d52a51d473.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a484e6b5cad40f631410b8d52a51d473.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacca8d0>
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_6601216adc06908f94a1e9aa9ad98ce9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_6601216adc06908f94a1e9aa9ad98ce9.jpg saved to cache
2026-03-28 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-28 12:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-28 12:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510 to the API
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_659ac0262ef99de42e9b141a624846e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': '92f46fc1-87e1-5d13-bdf2-6214e122592d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '38ktv7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT48510',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 119784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2373c25e76bbaaf4610f8f361c320a65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_2fbcee6ac3b6c72aa09b6a977a73e9b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_659ac0262ef99de42e9b141a624846e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_a1dd920d4e2da9285d815d5ac3cd8f4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92f46fc1-87e1-5d13-bdf2-6214e122592d/92f46fc1-87e1-5d13-bdf2-6214e122592d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f1/6cf1acab1dacb106972d7156748b2cce/pa/CT48510_64958c16c48b505c4719fefcffb965cb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-28 12:01:03 [auto1.nl] INFO: Saving data for CT48510: {'created_time': 1774699263.004623, 'last_price_update_time': 1774699263.004636, 'auction_closing_time': 1774884768.0}
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT48510') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-28 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-28 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922 to the API
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3413f2846dd2c6fe70d0337cb4087819.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:09:22Z',
 'fuel_type': 'petrol',
 'id': 'b187d90e-f2a0-5fe8-9a3d-550b69fae3ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XS075L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD76922',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 206564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331850,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3ced1ff203216ab017572866b91c2994.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2289371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_a9da27db0f3bb0a7a2cc9121a98ce7c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_4584b000d3ba0e8f4a1817ce1e9c17b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537868,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_b6296621d8b78ab649d3ed879f5e8274.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2144147,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_3413f2846dd2c6fe70d0337cb4087819.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_ac9543970d22e6fab96d0df684be0467.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2528057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_368fdd0658d32a4edd2389da2a63c893.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_34ac658e739a88745720ecb59f6130a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_41bd8c5e112b4f79c1d3ef2ffa99c925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b187d90e-f2a0-5fe8-9a3d-550b69fae3ba/b187d90e-f2a0-5fe8-9a3d-550b69fae3ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2188489,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/1b/1d1b9f0546bd75167667287cf863d637/pa/RD76922_6dd585d4b21af61dc1c7c844c80bb117.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-28 12:01:03 [auto1.nl] INFO: Saving data for RD76922: {'created_time': 1774699263.393796, 'last_price_update_time': 1774699263.393807, 'auction_closing_time': 1774883362.0}
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD76922') HTTP/1.1" 204 0
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_4c65f30fda3f90ef00703187d2fb7e6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_00da5c8576ae7edbffa2cc6067b829ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_d39bb3672e98316185379c7995dfff69.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9b8f510>
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_dc33e7e927d7d72b2839c77111774ea5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_dc33e7e927d7d72b2839c77111774ea5.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeef150>
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_41fd0ae092a9f6051b67542a51c2d486.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_41fd0ae092a9f6051b67542a51c2d486.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbe6cd0>
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_e85852f855cddc75ed33184fa547600b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_e85852f855cddc75ed33184fa547600b.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac574d0>
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_4c65f30fda3f90ef00703187d2fb7e6e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_4c65f30fda3f90ef00703187d2fb7e6e.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caff6d50>
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_00da5c8576ae7edbffa2cc6067b829ed.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_00da5c8576ae7edbffa2cc6067b829ed.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9aafd0>
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_d39bb3672e98316185379c7995dfff69.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_d39bb3672e98316185379c7995dfff69.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_0996d9324ff5d58cfee34856b1c278c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_c2e319a998060f1ce5df1c346cbae369.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_969096f404f75ce776db78204d9bf6e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a242419b90e94f7ee6eecb957ecefcce.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_c954cf0cd0de3a1677280e1c521ebb6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_2c1a41693ca184497496c02de5bf36b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_61503ccb149ad9c958bf21bf802e0a52.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_1665bdb84a113e80aa8698b96d2bd64e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8d669632a55b158f489103fc7e494f3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbabfc10>
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fc2%252F47c21b1ccc93f6f5ee29faabe18d14d0%252Fpa%252FKK51574_0996d9324ff5d58cfee34856b1c278c3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_0996d9324ff5d58cfee34856b1c278c3.jpg saved to cache
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7
2026-03-28 12:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c961ab1-82f0-50e8-8c69-306cd09de1a7, skipping ID generation
2026-03-28 12:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with scrape type 1
2026-03-28 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7 sending to next pipeline
2026-03-28 12:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1c961ab1-82f0-50e8-8c69-306cd09de1a7, identifier: KK51574
2026-03-28 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-28 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-28 12:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574 to the API
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_0996d9324ff5d58cfee34856b1c278c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:30:53Z',
 'fuel_type': 'petrol',
 'id': '1c961ab1-82f0-50e8-8c69-306cd09de1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '89NTL8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK51574',
 'listing': 'auction',
 'location': 'NL, Vianen',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 125968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_0996d9324ff5d58cfee34856b1c278c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_41fd0ae092a9f6051b67542a51c2d486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_00da5c8576ae7edbffa2cc6067b829ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_638ca85295094a96fbdb807c01953c8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c961ab1-82f0-50e8-8c69-306cd09de1a7/1c961ab1-82f0-50e8-8c69-306cd09de1a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/c2/47c21b1ccc93f6f5ee29faabe18d14d0/pa/KK51574_1827d3d5557a6e0079703c774f2b0ae7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2010}
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-28 12:01:04 [auto1.nl] INFO: Saving data for KK51574: {'created_time': 1774699264.702174, 'last_price_update_time': 1774699264.702183, 'auction_closing_time': 1774884653.0}
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK51574') HTTP/1.1" 204 0
2026-03-28 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac57e90>
2026-03-28 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F83%252Fc583a349aef18246250b25c1ec9852d6%252Fpa%252FKX15971_c2e319a998060f1ce5df1c346cbae369.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_c2e319a998060f1ce5df1c346cbae369.jpg saved to cache
2026-03-28 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54
2026-03-28 12:01:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54, skipping ID generation
2026-03-28 12:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with scrape type 1
2026-03-28 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 sending to next pipeline
2026-03-28 12:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54, identifier: KX15971
2026-03-28 12:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_43ea420ac88824728500061c53f4f41a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ46393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT51900> (referer: https://www.auto1.com/v1/car-details-view/ZT51900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-28 12:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-28 12:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971 to the API
2026-03-28 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_c2e319a998060f1ce5df1c346cbae369.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:00:17Z',
 'fuel_type': 'petrol',
 'id': '890261b5-6ca7-5909-a7a9-ad57bf3e6b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R955RG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX15971',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 101873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_c2e319a998060f1ce5df1c346cbae369.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_e85852f855cddc75ed33184fa547600b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_dc33e7e927d7d72b2839c77111774ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_b59acde9d58a87546bf81a3b03e67a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_890261b5-6ca7-5909-a7a9-ad57bf3e6b54/890261b5-6ca7-5909-a7a9-ad57bf3e6b54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/83/c583a349aef18246250b25c1ec9852d6/pa/KX15971_92477f77643bc6402f7f1e42cf9822f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-28 12:01:05 [auto1.nl] INFO: Saving data for KX15971: {'created_time': 1774699265.217792, 'last_price_update_time': 1774699265.217801, 'auction_closing_time': 1774882817.0}
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX15971') HTTP/1.1" 204 0
2026-03-28 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF84007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN94746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD48941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU38085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cabf9ed0>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_969096f404f75ce776db78204d9bf6e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_969096f404f75ce776db78204d9bf6e2.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9f7010>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_a242419b90e94f7ee6eecb957ecefcce.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a242419b90e94f7ee6eecb957ecefcce.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad951d0>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_c954cf0cd0de3a1677280e1c521ebb6e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_c954cf0cd0de3a1677280e1c521ebb6e.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b3750>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_2c1a41693ca184497496c02de5bf36b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_2c1a41693ca184497496c02de5bf36b7.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad94510>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_61503ccb149ad9c958bf21bf802e0a52.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_61503ccb149ad9c958bf21bf802e0a52.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb91b6d0>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_1665bdb84a113e80aa8698b96d2bd64e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_1665bdb84a113e80aa8698b96d2bd64e.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad47650>
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f5dc3b62a77b73ce58ed97107e3dfc%252Fpa%252FYZ60467_8d669632a55b158f489103fc7e494f3a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8d669632a55b158f489103fc7e494f3a.jpg saved to cache
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 348a5638-421f-592d-9f06-e9ad8871cc4f
2026-03-28 12:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 348a5638-421f-592d-9f06-e9ad8871cc4f, skipping ID generation
2026-03-28 12:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348a5638-421f-592d-9f06-e9ad8871cc4f with scrape type 1
2026-03-28 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 348a5638-421f-592d-9f06-e9ad8871cc4f sending to next pipeline
2026-03-28 12:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 348a5638-421f-592d-9f06-e9ad8871cc4f, identifier: YZ60467
2026-03-28 12:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-28 12:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-28 12:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467 to the API
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8d669632a55b158f489103fc7e494f3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:18:54Z',
 'fuel_type': 'petrol',
 'id': '348a5638-421f-592d-9f06-e9ad8871cc4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GK199V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ60467',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 59795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8d669632a55b158f489103fc7e494f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503146,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_c954cf0cd0de3a1677280e1c521ebb6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2584009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a242419b90e94f7ee6eecb957ecefcce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_969096f404f75ce776db78204d9bf6e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_a484e6b5cad40f631410b8d52a51d473.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_6b483517188b3e092bc98774b6089322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_00dae0ee440b828cdd9beba73df199cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_f2be87b24499746642bb82b5578c141d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_8e14340bbde5efaed52a7ce8224bea4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_348a5638-421f-592d-9f06-e9ad8871cc4f/348a5638-421f-592d-9f06-e9ad8871cc4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f5dc3b62a77b73ce58ed97107e3dfc/pa/YZ60467_b99cf1df2cb257fa70fbf0e5fb1e6ad7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2015}
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-28 12:01:06 [auto1.nl] INFO: Saving data for YZ60467: {'created_time': 1774699266.66846, 'last_price_update_time': 1774699266.668468, 'auction_closing_time': 1774883934.0}
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ60467') HTTP/1.1" 204 0
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad12450>
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_43ea420ac88824728500061c53f4f41a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_43ea420ac88824728500061c53f4f41a.jpg saved to cache
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-28 12:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49421184-a919-54bd-8e77-7aa2fe6a62d1 with scrape type 1
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 49421184-a919-54bd-8e77-7aa2fe6a62d1
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_6f9b4e91f892d94a9814a08c3efc5262.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_6f9b4e91f892d94a9814a08c3efc5262.jpg not downloaded yet
2026-03-28 12:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_fd72bafa1d82af6285c099b17560f8c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_fd72bafa1d82af6285c099b17560f8c0.jpg not downloaded yet
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_e8d4549c58dd67e878d5e0df78ecefc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_e8d4549c58dd67e878d5e0df78ecefc9.jpg not downloaded yet
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_80e377db2c2b6d951e83cc79c5a61079.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_80e377db2c2b6d951e83cc79c5a61079.jpg not downloaded yet
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_8bd87baea8bd7857d645008d75a82962.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_8bd87baea8bd7857d645008d75a82962.jpg not downloaded yet
2026-03-28 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e96ef8fdd3d2b2db172d21575d0169b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_19052a52100914fdcca6ecfb79fe5fa3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_123261c02f01ce746c90fbacfa551361.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_0716d51e1e9b7d20aa661614e55efb82.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba92d10>
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_e96ef8fdd3d2b2db172d21575d0169b3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e96ef8fdd3d2b2db172d21575d0169b3.jpg saved to cache
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c268dcc20e80ab8f391ef21daea5ce47.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_8dce7e03228eb1ab85394f3bf2770da9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_38978a1563448ea64414dcb9bbc6f9ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_a76ca7c4807a74918f7c6726863070e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba92b90>
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_19052a52100914fdcca6ecfb79fe5fa3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_19052a52100914fdcca6ecfb79fe5fa3.jpg saved to cache
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba8d590>
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_123261c02f01ce746c90fbacfa551361.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_123261c02f01ce746c90fbacfa551361.jpg saved to cache
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb79ad0>
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F48%252F4848f41232728f85d739407246be7952%252Fpa%252FZB71006_0716d51e1e9b7d20aa661614e55efb82.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_0716d51e1e9b7d20aa661614e55efb82.jpg saved to cache
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5333bba5-93d3-52c1-b6ec-9f61023e9919
2026-03-28 12:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5333bba5-93d3-52c1-b6ec-9f61023e9919, skipping ID generation
2026-03-28 12:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5333bba5-93d3-52c1-b6ec-9f61023e9919 with scrape type 1
2026-03-28 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5333bba5-93d3-52c1-b6ec-9f61023e9919 sending to next pipeline
2026-03-28 12:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5333bba5-93d3-52c1-b6ec-9f61023e9919, identifier: ZB71006
2026-03-28 12:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-28 12:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-28 12:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006 to the API
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_0716d51e1e9b7d20aa661614e55efb82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:10:44Z',
 'fuel_type': 'hybrid',
 'id': '5333bba5-93d3-52c1-b6ec-9f61023e9919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KV578P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB71006',
 'listing': 'auction',
 'location': 'NL, Koog aan de Zaan',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 184309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_0716d51e1e9b7d20aa661614e55efb82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_19052a52100914fdcca6ecfb79fe5fa3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_61503ccb149ad9c958bf21bf802e0a52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_ac3138e070f740fc7365b8de3ec85f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_d39bb3672e98316185379c7995dfff69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2453441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_e2f91e71efbafbc28cd985ea0aa56058.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_18fb131d4add338b12ee7944d6c50164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_972ba0cb02f22998ea1fd43d294937a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_087c102d488d2b1403d27eacd9becd6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5333bba5-93d3-52c1-b6ec-9f61023e9919/5333bba5-93d3-52c1-b6ec-9f61023e9919_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/48/4848f41232728f85d739407246be7952/pa/ZB71006_7f0824cff829956145e68a997bb5c3f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2016}
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-28 12:01:07 [auto1.nl] INFO: Saving data for ZB71006: {'created_time': 1774699267.979346, 'last_price_update_time': 1774699267.979361, 'auction_closing_time': 1774883444.0}
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZB71006') HTTP/1.1" 204 0
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_80e377db2c2b6d951e83cc79c5a61079.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_8bd87baea8bd7857d645008d75a82962.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_a1c009d0dabee9ea755f440f7f3b08bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX51815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ12224/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb917d0>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_c268dcc20e80ab8f391ef21daea5ce47.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c268dcc20e80ab8f391ef21daea5ce47.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba9dd90>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_8dce7e03228eb1ab85394f3bf2770da9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_8dce7e03228eb1ab85394f3bf2770da9.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb860a90>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_38978a1563448ea64414dcb9bbc6f9ba.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_38978a1563448ea64414dcb9bbc6f9ba.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba73590>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_a76ca7c4807a74918f7c6726863070e4.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_a76ca7c4807a74918f7c6726863070e4.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_6f9b4e91f892d94a9814a08c3efc5262.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_fd72bafa1d82af6285c099b17560f8c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_e8d4549c58dd67e878d5e0df78ecefc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf34710>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_80e377db2c2b6d951e83cc79c5a61079.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_80e377db2c2b6d951e83cc79c5a61079.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49421184-a919-54bd-8e77-7aa2fe6a62d1
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeaa410>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_8bd87baea8bd7857d645008d75a82962.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_8bd87baea8bd7857d645008d75a82962.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49421184-a919-54bd-8e77-7aa2fe6a62d1
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba6cad0>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_a1c009d0dabee9ea755f440f7f3b08bd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_a1c009d0dabee9ea755f440f7f3b08bd.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:01:08 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:08 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-28 12:01:08 [auto1.nl] INFO: Scrape type for WZ79997: 1
2026-03-28 12:01:08 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-28 12:01:08 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-28 12:01:08 [auto1.nl] INFO: Scrape type for MP39959: 1
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf3cad0>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_6f9b4e91f892d94a9814a08c3efc5262.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_6f9b4e91f892d94a9814a08c3efc5262.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49421184-a919-54bd-8e77-7aa2fe6a62d1
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae08e10>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_fd72bafa1d82af6285c099b17560f8c0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_fd72bafa1d82af6285c099b17560f8c0.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49421184-a919-54bd-8e77-7aa2fe6a62d1
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb872a50>
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F3a%252Fd63a77140d8c2c8fdde15ee1b220f0f1%252Fpa%252FZT51900_e8d4549c58dd67e878d5e0df78ecefc9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_e8d4549c58dd67e878d5e0df78ecefc9.jpg saved to cache
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49421184-a919-54bd-8e77-7aa2fe6a62d1
2026-03-28 12:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49421184-a919-54bd-8e77-7aa2fe6a62d1, skipping ID generation
2026-03-28 12:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49421184-a919-54bd-8e77-7aa2fe6a62d1 with scrape type 1
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49421184-a919-54bd-8e77-7aa2fe6a62d1 sending to next pipeline
2026-03-28 12:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 49421184-a919-54bd-8e77-7aa2fe6a62d1, identifier: ZT51900
2026-03-28 12:01:08 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-28 12:01:08 [auto1.nl] INFO: Scrape type for YN95467: 2
2026-03-28 12:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-28 12:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b806ca-e617-5017-9a8f-cf159d2a0074 with scrape type 2
2026-03-28 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23b806ca-e617-5017-9a8f-cf159d2a0074 with scrape type 2
2026-03-28 12:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 23b806ca-e617-5017-9a8f-cf159d2a0074, identifier: YN95467
2026-03-28 12:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-28 12:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-28 12:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900 to the API
2026-03-28 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_e8d4549c58dd67e878d5e0df78ecefc9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'diesel',
 'id': '49421184-a919-54bd-8e77-7aa2fe6a62d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'VF260K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT51900',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 249395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_6f9b4e91f892d94a9814a08c3efc5262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_fd72bafa1d82af6285c099b17560f8c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_e8d4549c58dd67e878d5e0df78ecefc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_80e377db2c2b6d951e83cc79c5a61079.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49421184-a919-54bd-8e77-7aa2fe6a62d1/49421184-a919-54bd-8e77-7aa2fe6a62d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/3a/d63a77140d8c2c8fdde15ee1b220f0f1/pa/ZT51900_8bd87baea8bd7857d645008d75a82962.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Basis',
 'transmission': 'manual',
 'trim': 'Rapid Basis',
 'year': 2010}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-28 12:01:09 [auto1.nl] INFO: Saving data for ZT51900: {'created_time': 1774699269.170171, 'last_price_update_time': 1774699269.17018, 'auction_closing_time': 1774882852.0}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZT51900') HTTP/1.1" 204 0
2026-03-28 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_111f02ec411144635c1efcd3e0957fb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-28 12:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-28 12:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467 to the API
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:11:45Z',
 'fuel_type': 'petrol',
 'id': '23b806ca-e617-5017-9a8f-cf159d2a0074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN95467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 339212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-02',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-28 12:01:09 [auto1.nl] INFO: Saving data for YN95467: {'auction_closing_time': 1774883505.0, 'created_time': 1773343671.482367, 'last_price_update_time': 1774699269.538904}
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN95467') HTTP/1.1" 204 0
2026-03-28 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_d745a60d72cc1f12f223606b94b20e6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_836c87de11db47fb35b8b5fd945b6e5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:09 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-28 12:01:09 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-28 12:01:09 [auto1.nl] INFO: Scrape type for AW17903: 1
2026-03-28 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF84007> (referer: https://www.auto1.com/v1/car-details-view/JF84007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN94746> (referer: https://www.auto1.com/v1/car-details-view/WN94746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:09 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-28 12:01:09 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-28 12:01:09 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-28 12:01:09 [auto1.nl] INFO: Scrape type for NC22018: 2
2026-03-28 12:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-28 12:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992869ee-8e19-5896-bff5-5f5d685d7384 with scrape type 2
2026-03-28 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992869ee-8e19-5896-bff5-5f5d685d7384 with scrape type 2
2026-03-28 12:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 992869ee-8e19-5896-bff5-5f5d685d7384, identifier: NC22018
2026-03-28 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ46393> (referer: https://www.auto1.com/v1/car-details-view/DJ46393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba8dc50>
2026-03-28 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_111f02ec411144635c1efcd3e0957fb7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_111f02ec411144635c1efcd3e0957fb7.jpg saved to cache
2026-03-28 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-28 12:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-28 12:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018 to the API
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:52:24Z',
 'fuel_type': 'petrol',
 'id': '992869ee-8e19-5896-bff5-5f5d685d7384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC22018',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 58238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'MINI Cooper 60 Years',
 'transmission': 'automatic',
 'trim': '60 Years',
 'year': 2020}
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Saving data for NC22018: {'auction_closing_time': 1774885944.0, 'created_time': 1773343175.476087, 'last_price_update_time': 1774699270.078028}
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC22018') HTTP/1.1" 204 0
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_2379eea96d2a42de10bcfee8a90dd606.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for ZG49112: 1
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_3ea3ace75c00fc1a474060ec614740a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW85568%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for XW85568: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for AR13994: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for CA41421: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for ZA54727: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for BX02996: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for CG41463: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for FV36091: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for SJ21377: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for DG42232: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for EU22503: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [auto1.nl] INFO: Scrape type for CS76145: 0
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 12:01:10 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac887d0>
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_d745a60d72cc1f12f223606b94b20e6f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_d745a60d72cc1f12f223606b94b20e6f.jpg saved to cache
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbc4b90>
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_836c87de11db47fb35b8b5fd945b6e5b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_836c87de11db47fb35b8b5fd945b6e5b.jpg saved to cache
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-28 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a0e11b-1e01-5d26-84aa-8887a06e5405 with scrape type 1
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_cef6ab63d91b21272f42faaa148a2335.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cef6ab63d91b21272f42faaa148a2335.jpg not downloaded yet
2026-03-28 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-28 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac72c08-1d0a-5646-915f-155391cbd170 with scrape type 1
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2ac72c08-1d0a-5646-915f-155391cbd170
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_c24e60f8756a18377173b80586099587.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_c24e60f8756a18377173b80586099587.jpg not downloaded yet
2026-03-28 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-28 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with scrape type 1
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_0fc6185e1b04d2ae578616c652cb85e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_0fc6185e1b04d2ae578616c652cb85e8.jpg not downloaded yet
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3718a4d9e62a8cebecabb7e8d61a70ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_41231a289ca91d4776fe297fb6812b0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_41231a289ca91d4776fe297fb6812b0e.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_1510efe142ddc3a03608dcc5cbc50ec9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_1510efe142ddc3a03608dcc5cbc50ec9.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_35227b304d321d84873672664d9424f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_35227b304d321d84873672664d9424f5.jpg not downloaded yet
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU38085> (referer: https://www.auto1.com/v1/car-details-view/EU38085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP52845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8073d0>
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_2379eea96d2a42de10bcfee8a90dd606.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_2379eea96d2a42de10bcfee8a90dd606.jpg saved to cache
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacbb1d0>
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_3ea3ace75c00fc1a474060ec614740a0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_3ea3ace75c00fc1a474060ec614740a0.jpg saved to cache
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_24860cb1cd0e5495b433a544ed58fefd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_24860cb1cd0e5495b433a544ed58fefd.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_11138afc2a277d1ec5ccfd0e4af5c27c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_11138afc2a277d1ec5ccfd0e4af5c27c.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_3b978a6170c500bb667a612978e3c095.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_3b978a6170c500bb667a612978e3c095.jpg not downloaded yet
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba24990>
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_3718a4d9e62a8cebecabb7e8d61a70ca.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3718a4d9e62a8cebecabb7e8d61a70ca.jpg saved to cache
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_e8bdc1dddfdadf793e7235fa6731a873.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_e8bdc1dddfdadf793e7235fa6731a873.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_5097fa5ae145f690d6ea0492e45e3566.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_5097fa5ae145f690d6ea0492e45e3566.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_52095addfc63041c92593a4935efb04f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_52095addfc63041c92593a4935efb04f.jpg not downloaded yet
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3702281608a06679f1d6bf4a558dd0f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_0fc6185e1b04d2ae578616c652cb85e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-28 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2cef4e-0091-545e-a089-052ef2312c17 with scrape type 1
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_06d0f8588bebc1f27d7faca24d793da2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_06d0f8588bebc1f27d7faca24d793da2.jpg not downloaded yet
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_c24e60f8756a18377173b80586099587.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cef6ab63d91b21272f42faaa148a2335.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_15288b3dd68a5230d94d0705c20acba0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_15288b3dd68a5230d94d0705c20acba0.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_564354bf17e9ce866dfc097b858d094c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_564354bf17e9ce866dfc097b858d094c.jpg not downloaded yet
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_472c892924405985e5149de61a24ee37.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_472c892924405985e5149de61a24ee37.jpg not downloaded yet
2026-03-28 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_7d4a3fcfff3d4d56e956fc75bd0402b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_fa78c38fd56052c430631be1a5a8d387.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fa78c38fd56052c430631be1a5a8d387.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_c9b1eb975725827093b189c49c269bd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_c9b1eb975725827093b189c49c269bd6.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_10b736666f2535acd1c542152ff98717.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_10b736666f2535acd1c542152ff98717.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_f76c752490bbceb7fb3cd6536aa27f6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_f76c752490bbceb7fb3cd6536aa27f6f.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_f5a839335d1dfc4e52adf86d6dcc75c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f5a839335d1dfc4e52adf86d6dcc75c6.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_f2a52bbf2d5d56b4e18859dd77e43aae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_f2a52bbf2d5d56b4e18859dd77e43aae.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_1e4dd8fc19ff1a6e93dfd558547dff49.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_1e4dd8fc19ff1a6e93dfd558547dff49.jpg not downloaded yet
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ79997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_3b978a6170c500bb667a612978e3c095.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_11138afc2a277d1ec5ccfd0e4af5c27c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_5097fa5ae145f690d6ea0492e45e3566.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_a657b796e3b44a51d0c38a27831e73a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_a657b796e3b44a51d0c38a27831e73a3.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_cde1ef63b07b1a48afd4bcbb308f05bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cde1ef63b07b1a48afd4bcbb308f05bc.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_4997fb4d488ba8d0d53de5d387385c89.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4997fb4d488ba8d0d53de5d387385c89.jpg not downloaded yet
2026-03-28 12:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caed2410>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_3702281608a06679f1d6bf4a558dd0f9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3702281608a06679f1d6bf4a558dd0f9.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8ab650>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_0fc6185e1b04d2ae578616c652cb85e8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_0fc6185e1b04d2ae578616c652cb85e8.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad34a10>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_c24e60f8756a18377173b80586099587.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_c24e60f8756a18377173b80586099587.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ac72c08-1d0a-5646-915f-155391cbd170
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae4f4d0>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_cef6ab63d91b21272f42faaa148a2335.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cef6ab63d91b21272f42faaa148a2335.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_37148a45477ad36fc5e925e725757805.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_52095addfc63041c92593a4935efb04f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_902f7c85c973473ad76c6e3a16dbc7ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_902f7c85c973473ad76c6e3a16dbc7ac.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_85efeea4bdaf7c2e365439df9822932d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_85efeea4bdaf7c2e365439df9822932d.jpg not downloaded yet
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_cc68853c92639ba415fe9a5bf7adb50e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_cc68853c92639ba415fe9a5bf7adb50e.jpg not downloaded yet
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9fb8c0d63ca48471e6d4f5eb8013557a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_40a3070bd28295c541fd501a4e7ac2fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_40a3070bd28295c541fd501a4e7ac2fc.jpg not downloaded yet
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP39959/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW17903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad2fa50>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1b%252Fd21bf927908e85f543821f86a0c99cae%252Fpa%252FAK27162_7d4a3fcfff3d4d56e956fc75bd0402b8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_7d4a3fcfff3d4d56e956fc75bd0402b8.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a29dff94-6ab8-5f78-aa8c-49d7297720b8
2026-03-28 12:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a29dff94-6ab8-5f78-aa8c-49d7297720b8, skipping ID generation
2026-03-28 12:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29dff94-6ab8-5f78-aa8c-49d7297720b8 with scrape type 1
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a29dff94-6ab8-5f78-aa8c-49d7297720b8 sending to next pipeline
2026-03-28 12:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a29dff94-6ab8-5f78-aa8c-49d7297720b8, identifier: AK27162
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb96b310>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_3b978a6170c500bb667a612978e3c095.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_3b978a6170c500bb667a612978e3c095.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf87350>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_11138afc2a277d1ec5ccfd0e4af5c27c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_11138afc2a277d1ec5ccfd0e4af5c27c.jpg saved to cache
2026-03-28 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ac72c08-1d0a-5646-915f-155391cbd170
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb85eb10>
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_5097fa5ae145f690d6ea0492e45e3566.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_5097fa5ae145f690d6ea0492e45e3566.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ac72c08-1d0a-5646-915f-155391cbd170
2026-03-28 12:01:12 [scrapy.extensions.logstats] INFO: Crawled 92 pages (at 92 pages/min), scraped 33 items (at 33 items/min)
2026-03-28 12:01:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 186MiB
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_2bf7cb2c3da592347f7581f245013933.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_2bf7cb2c3da592347f7581f245013933.jpg not downloaded yet
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_4acdaa50d55b4b5d2c6d0242f44e2a60.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4acdaa50d55b4b5d2c6d0242f44e2a60.jpg not downloaded yet
2026-03-28 12:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-28 12:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-28 12:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162 to the API
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_7d4a3fcfff3d4d56e956fc75bd0402b8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:56:17Z',
 'fuel_type': 'petrol',
 'id': 'a29dff94-6ab8-5f78-aa8c-49d7297720b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TL867J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK27162',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 162951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e96ef8fdd3d2b2db172d21575d0169b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3061880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_7d4a3fcfff3d4d56e956fc75bd0402b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2987019,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_123261c02f01ce746c90fbacfa551361.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_43ea420ac88824728500061c53f4f41a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_1665bdb84a113e80aa8698b96d2bd64e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2916571,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_2c1a41693ca184497496c02de5bf36b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_4c65f30fda3f90ef00703187d2fb7e6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2990989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_6601216adc06908f94a1e9aa9ad98ce9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_dad3bc956c8c6a3e278634c57aab6558.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29dff94-6ab8-5f78-aa8c-49d7297720b8/a29dff94-6ab8-5f78-aa8c-49d7297720b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/1b/d21bf927908e85f543821f86a0c99cae/pa/AK27162_e6dbb6221b92d4e8013a5724e7a202a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [auto1.nl] INFO: Saving data for AK27162: {'created_time': 1774699272.488038, 'last_price_update_time': 1774699272.488047, 'auction_closing_time': 1774886177.0}
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AK27162') HTTP/1.1" 204 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_f4a598ab9711e4f86899324f3a3cf07b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f4a598ab9711e4f86899324f3a3cf07b.jpg not downloaded yet
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ12224> (referer: https://www.auto1.com/v1/car-details-view/NJ12224/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG49112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafb5550>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_37148a45477ad36fc5e925e725757805.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_37148a45477ad36fc5e925e725757805.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba72490>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_52095addfc63041c92593a4935efb04f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_52095addfc63041c92593a4935efb04f.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeee6d0>
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_9fb8c0d63ca48471e6d4f5eb8013557a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9fb8c0d63ca48471e6d4f5eb8013557a.jpg saved to cache
2026-03-28 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_fb8015ede2791aabda17c00b07d17e6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fb8015ede2791aabda17c00b07d17e6e.jpg not downloaded yet
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD48941> (referer: https://www.auto1.com/v1/car-details-view/KD48941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX51815> (referer: https://www.auto1.com/v1/car-details-view/DX51815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_bc0d6409cb5347fa44a2d69a4e1539f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_bc0d6409cb5347fa44a2d69a4e1539f1.jpg not downloaded yet
2026-03-28 12:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-28 12:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6225da9c-cd5e-52d7-89f4-e343143e4f34 with scrape type 1
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_28b6070f19b1324f499d9d46ff2e4d1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_28b6070f19b1324f499d9d46ff2e4d1e.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_c4e9999fc73674ab9d34ff4efb4ba64c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_c4e9999fc73674ab9d34ff4efb4ba64c.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_8945e7e17f7c5e1b1ce5ae8b4aca9249.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_8945e7e17f7c5e1b1ce5ae8b4aca9249.jpg not downloaded yet
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_936d4507b283041d7f33e64e6687e1fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_65283952288061695c63a9fe9200aad3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_65283952288061695c63a9fe9200aad3.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_d0c25feb67f62f56f649ebb3f9010c69.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_d0c25feb67f62f56f649ebb3f9010c69.jpg not downloaded yet
2026-03-28 12:01:13 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-28 12:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444b097d-a620-589d-bc25-11cf1320e560 with scrape type 1
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 444b097d-a620-589d-bc25-11cf1320e560
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_f20bd73ffded172ea94293a5bcd32b4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f20bd73ffded172ea94293a5bcd32b4f.jpg not downloaded yet
2026-03-28 12:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-28 12:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99394b93-3aa2-5ad8-b39d-267937e48230 with scrape type 1
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_88682b320b9b4fd0009226047bfbc7ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_88682b320b9b4fd0009226047bfbc7ff.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_7e193b81333d14b5036bb54b8c44ee54.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_7e193b81333d14b5036bb54b8c44ee54.jpg not downloaded yet
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for GA85229: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS44884%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for YS44884: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for UR86175: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED59845%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [auto1.nl] INFO: Scrape type for ED59845: 0
2026-03-28 12:01:13 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_4c2c21999442ce3196e5e813c9b5c5d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_4c2c21999442ce3196e5e813c9b5c5d2.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_27a2bc7005ee4dbbb1b17b5a2ea6a6b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_27a2bc7005ee4dbbb1b17b5a2ea6a6b7.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_f83cf909fa86b3cec5ff43db1dd4a184.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_f83cf909fa86b3cec5ff43db1dd4a184.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_f4a14d5e998d77db1a920f474bd846d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f4a14d5e998d77db1a920f474bd846d3.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_50e2501c188ea327792dfbfc92903855.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_50e2501c188ea327792dfbfc92903855.jpg not downloaded yet
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_2bf7cb2c3da592347f7581f245013933.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_cc68853c92639ba415fe9a5bf7adb50e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4acdaa50d55b4b5d2c6d0242f44e2a60.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_e5b4160c4e9635e8d4bf57dfee279c20.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_e5b4160c4e9635e8d4bf57dfee279c20.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_73c9153346de9b3447ac8399f73b3a69.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_73c9153346de9b3447ac8399f73b3a69.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_2a38b333f3d1de5cd02fd55a001667b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_2a38b333f3d1de5cd02fd55a001667b3.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_138426808a233e56e05e3260dc17f2ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_138426808a233e56e05e3260dc17f2ac.jpg not downloaded yet
2026-03-28 12:01:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac17550>
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_936d4507b283041d7f33e64e6687e1fa.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_936d4507b283041d7f33e64e6687e1fa.jpg saved to cache
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_d4d0231d145b1124728d444d1dd3ed27.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_d4d0231d145b1124728d444d1dd3ed27.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_590e8b63404c5d60cca0c818726a685d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_590e8b63404c5d60cca0c818726a685d.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_af55dc8c4d3ee53775ee172279e55dd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_af55dc8c4d3ee53775ee172279e55dd6.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_f5731697e45bbad183dd98144308bd91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_f5731697e45bbad183dd98144308bd91.jpg not downloaded yet
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_9f97e03806a0241a51b08e37a57fd09c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_9f97e03806a0241a51b08e37a57fd09c.jpg not downloaded yet
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cde1ef63b07b1a48afd4bcbb308f05bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_a657b796e3b44a51d0c38a27831e73a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_e0d5c9b2f0364d9683842ae8071fed83.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_e0d5c9b2f0364d9683842ae8071fed83.jpg not downloaded yet
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbae5350>
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_2bf7cb2c3da592347f7581f245013933.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_2bf7cb2c3da592347f7581f245013933.jpg saved to cache
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec0f50>
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_cc68853c92639ba415fe9a5bf7adb50e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_cc68853c92639ba415fe9a5bf7adb50e.jpg saved to cache
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac15790>
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_4acdaa50d55b4b5d2c6d0242f44e2a60.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4acdaa50d55b4b5d2c6d0242f44e2a60.jpg saved to cache
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4997fb4d488ba8d0d53de5d387385c89.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_0ef6359e0e8e0a86247b7c8d7c84071e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_0ef6359e0e8e0a86247b7c8d7c84071e.jpg not downloaded yet
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae65e50>
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_cde1ef63b07b1a48afd4bcbb308f05bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cde1ef63b07b1a48afd4bcbb308f05bc.jpg saved to cache
2026-03-28 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbaa8990>
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_a657b796e3b44a51d0c38a27831e73a3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_a657b796e3b44a51d0c38a27831e73a3.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_f83cf909fa86b3cec5ff43db1dd4a184.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_8945e7e17f7c5e1b1ce5ae8b4aca9249.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae03e10>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_4997fb4d488ba8d0d53de5d387385c89.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4997fb4d488ba8d0d53de5d387385c89.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f4a598ab9711e4f86899324f3a3cf07b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fb8015ede2791aabda17c00b07d17e6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_40a3070bd28295c541fd501a4e7ac2fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_902f7c85c973473ad76c6e3a16dbc7ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_85efeea4bdaf7c2e365439df9822932d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_1e4dd8fc19ff1a6e93dfd558547dff49.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb82b950>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_f83cf909fa86b3cec5ff43db1dd4a184.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_f83cf909fa86b3cec5ff43db1dd4a184.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_f5731697e45bbad183dd98144308bd91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec05d0>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_8945e7e17f7c5e1b1ce5ae8b4aca9249.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_8945e7e17f7c5e1b1ce5ae8b4aca9249.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_0ef6359e0e8e0a86247b7c8d7c84071e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_e0d5c9b2f0364d9683842ae8071fed83.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb969490>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_f4a598ab9711e4f86899324f3a3cf07b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f4a598ab9711e4f86899324f3a3cf07b.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad8f790>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_fb8015ede2791aabda17c00b07d17e6e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fb8015ede2791aabda17c00b07d17e6e.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb969b10>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_40a3070bd28295c541fd501a4e7ac2fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_40a3070bd28295c541fd501a4e7ac2fc.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac09310>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_902f7c85c973473ad76c6e3a16dbc7ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_902f7c85c973473ad76c6e3a16dbc7ac.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacb4f90>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_85efeea4bdaf7c2e365439df9822932d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_85efeea4bdaf7c2e365439df9822932d.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad8e750>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_1e4dd8fc19ff1a6e93dfd558547dff49.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_1e4dd8fc19ff1a6e93dfd558547dff49.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_4c2c21999442ce3196e5e813c9b5c5d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_27a2bc7005ee4dbbb1b17b5a2ea6a6b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW17903> (referer: https://www.auto1.com/v1/car-details-view/AW17903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ79997> (referer: https://www.auto1.com/v1/car-details-view/WZ79997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbabb010>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_f5731697e45bbad183dd98144308bd91.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_f5731697e45bbad183dd98144308bd91.jpg saved to cache
2026-03-28 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9a0a010>
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_0ef6359e0e8e0a86247b7c8d7c84071e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_0ef6359e0e8e0a86247b7c8d7c84071e.jpg saved to cache
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb82a3d0>
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_e0d5c9b2f0364d9683842ae8071fed83.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_e0d5c9b2f0364d9683842ae8071fed83.jpg saved to cache
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbafb750>
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_4c2c21999442ce3196e5e813c9b5c5d2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_4c2c21999442ce3196e5e813c9b5c5d2.jpg saved to cache
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 444b097d-a620-589d-bc25-11cf1320e560
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafb7390>
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_27a2bc7005ee4dbbb1b17b5a2ea6a6b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_27a2bc7005ee4dbbb1b17b5a2ea6a6b7.jpg saved to cache
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-28 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7d487d-b708-5833-a488-56123a041330 with scrape type 1
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e7d487d-b708-5833-a488-56123a041330
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_49f97b77002e29d57b54426183c69a05.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_49f97b77002e29d57b54426183c69a05.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_75717fceb32f0a9f424ce0997abb556b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_75717fceb32f0a9f424ce0997abb556b.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_592d04f474558cf264dbbcbe519dab7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_592d04f474558cf264dbbcbe519dab7b.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_d9143095a6c38f03efc1fe9d941b18e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_d9143095a6c38f03efc1fe9d941b18e5.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_9fc73f9baa80d7217c2215bd2407698b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_9fc73f9baa80d7217c2215bd2407698b.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_ea121a544db6b0ed431608abada94a1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_ea121a544db6b0ed431608abada94a1e.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_c3afe4bcd03a28abd7a68d9ba90a321b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_c3afe4bcd03a28abd7a68d9ba90a321b.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_678c74368baf32ee7640ea34d17b5f36.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_678c74368baf32ee7640ea34d17b5f36.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_06c1483397a8f731786a0ccc4837789e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_06c1483397a8f731786a0ccc4837789e.jpg already downloaded
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fb1%252F36b1e5dd057907f5fe67f06d6cfbb24b%252Fpa%252FAW17903_fbab05c815983b1978c603ba8fb539e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_fbab05c815983b1978c603ba8fb539e6.jpg already downloaded
2026-03-28 12:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e7d487d-b708-5833-a488-56123a041330, identifier: AW17903
2026-03-28 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-28 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with scrape type 1
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_87f8434f08a6a9fbf7f015c8d899a654.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_87f8434f08a6a9fbf7f015c8d899a654.jpg not downloaded yet
2026-03-28 12:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-28 12:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-28 12:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903 to the API
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW17903>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:05:39Z',
 'fuel_type': 'petrol',
 'id': '2e7d487d-b708-5833-a488-56123a041330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HBG73D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW17903',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 91578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_49f97b77002e29d57b54426183c69a05.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_75717fceb32f0a9f424ce0997abb556b.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_592d04f474558cf264dbbcbe519dab7b.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_d9143095a6c38f03efc1fe9d941b18e5.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_9fc73f9baa80d7217c2215bd2407698b.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_ea121a544db6b0ed431608abada94a1e.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_c3afe4bcd03a28abd7a68d9ba90a321b.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_678c74368baf32ee7640ea34d17b5f36.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_06c1483397a8f731786a0ccc4837789e.jpg',
                'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_fbab05c815983b1978c603ba8fb539e6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_49f97b77002e29d57b54426183c69a05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_75717fceb32f0a9f424ce0997abb556b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_592d04f474558cf264dbbcbe519dab7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2773989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_d9143095a6c38f03efc1fe9d941b18e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_9fc73f9baa80d7217c2215bd2407698b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_ea121a544db6b0ed431608abada94a1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2812897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_c3afe4bcd03a28abd7a68d9ba90a321b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_678c74368baf32ee7640ea34d17b5f36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_06c1483397a8f731786a0ccc4837789e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7d487d-b708-5833-a488-56123a041330/2e7d487d-b708-5833-a488-56123a041330_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/b1/36b1e5dd057907f5fe67f06d6cfbb24b/pa/AW17903_fbab05c815983b1978c603ba8fb539e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-28 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [auto1.nl] INFO: Saving data for AW17903: {'created_time': 1774699276.004827, 'last_price_update_time': 1774699276.004838, 'auction_closing_time': 1774883139.0}
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW17903') HTTP/1.1" 204 0
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_d4d0231d145b1124728d444d1dd3ed27.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_e5b4160c4e9635e8d4bf57dfee279c20.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_592a01f3db281dda6decdb97be70c697.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_592a01f3db281dda6decdb97be70c697.jpg not downloaded yet
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_73c9153346de9b3447ac8399f73b3a69.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_590e8b63404c5d60cca0c818726a685d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_ccbefb3434b2545ac3bab467f4a52843.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_ccbefb3434b2545ac3bab467f4a52843.jpg not downloaded yet
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_3007728d11551b157b994ed2c8cbcd40.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3007728d11551b157b994ed2c8cbcd40.jpg not downloaded yet
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_2a38b333f3d1de5cd02fd55a001667b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_51f92a7356a678dfeb215f5baa9c5e65.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_51f92a7356a678dfeb215f5baa9c5e65.jpg not downloaded yet
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_7e193b81333d14b5036bb54b8c44ee54.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_a2e8c5f472b263f506c47af439f73f64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_a2e8c5f472b263f506c47af439f73f64.jpg not downloaded yet
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_88682b320b9b4fd0009226047bfbc7ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_1d49ad6727d874f335c7f29a2d0e2df6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_1d49ad6727d874f335c7f29a2d0e2df6.jpg not downloaded yet
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad6d550>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_d4d0231d145b1124728d444d1dd3ed27.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_d4d0231d145b1124728d444d1dd3ed27.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 444b097d-a620-589d-bc25-11cf1320e560
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac06950>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_e5b4160c4e9635e8d4bf57dfee279c20.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_e5b4160c4e9635e8d4bf57dfee279c20.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f20bd73ffded172ea94293a5bcd32b4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_b16f7d89ae119f68a5ee059c13651bde.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_b16f7d89ae119f68a5ee059c13651bde.jpg not downloaded yet
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_d0c25feb67f62f56f649ebb3f9010c69.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f4a14d5e998d77db1a920f474bd846d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbf0cd0>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_73c9153346de9b3447ac8399f73b3a69.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_73c9153346de9b3447ac8399f73b3a69.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 444b097d-a620-589d-bc25-11cf1320e560
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafc1090>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_590e8b63404c5d60cca0c818726a685d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_590e8b63404c5d60cca0c818726a685d.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_50e2501c188ea327792dfbfc92903855.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_87f8434f08a6a9fbf7f015c8d899a654.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_3f2e9afd82ccf03d32943f152e379c33.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3f2e9afd82ccf03d32943f152e379c33.jpg not downloaded yet
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_e6c3cb2c2b784bb161281f4f67846e3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_e6c3cb2c2b784bb161281f4f67846e3e.jpg not downloaded yet
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad2cc90>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_2a38b333f3d1de5cd02fd55a001667b3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_2a38b333f3d1de5cd02fd55a001667b3.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacdc7d0>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_7e193b81333d14b5036bb54b8c44ee54.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_7e193b81333d14b5036bb54b8c44ee54.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb968bd0>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_88682b320b9b4fd0009226047bfbc7ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_88682b320b9b4fd0009226047bfbc7ff.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf32210>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_f20bd73ffded172ea94293a5bcd32b4f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f20bd73ffded172ea94293a5bcd32b4f.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 444b097d-a620-589d-bc25-11cf1320e560
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_af55dc8c4d3ee53775ee172279e55dd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2da693510>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_d0c25feb67f62f56f649ebb3f9010c69.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_d0c25feb67f62f56f649ebb3f9010c69.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad946d0>
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F9d%252F049de110e06dab0cb86a2587c48365e4%252Fpa%252FKD48941_f4a14d5e998d77db1a920f474bd846d3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f4a14d5e998d77db1a920f474bd846d3.jpg saved to cache
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 444b097d-a620-589d-bc25-11cf1320e560
2026-03-28 12:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 444b097d-a620-589d-bc25-11cf1320e560, skipping ID generation
2026-03-28 12:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444b097d-a620-589d-bc25-11cf1320e560 with scrape type 1
2026-03-28 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 444b097d-a620-589d-bc25-11cf1320e560 sending to next pipeline
2026-03-28 12:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 444b097d-a620-589d-bc25-11cf1320e560, identifier: KD48941
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3007728d11551b157b994ed2c8cbcd40.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_ccbefb3434b2545ac3bab467f4a52843.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_c4e9999fc73674ab9d34ff4efb4ba64c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-28 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-28 12:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941 to the API
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f4a14d5e998d77db1a920f474bd846d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:31:18Z',
 'fuel_type': 'petrol',
 'id': '444b097d-a620-589d-bc25-11cf1320e560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '09PXF9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD48941',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 71806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f20bd73ffded172ea94293a5bcd32b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_4c2c21999442ce3196e5e813c9b5c5d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_f4a14d5e998d77db1a920f474bd846d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_73c9153346de9b3447ac8399f73b3a69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444b097d-a620-589d-bc25-11cf1320e560/444b097d-a620-589d-bc25-11cf1320e560_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/9d/049de110e06dab0cb86a2587c48365e4/pa/KD48941_d4d0231d145b1124728d444d1dd3ed27.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2011}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.nl] INFO: Saving data for KD48941: {'created_time': 1774699277.292958, 'last_price_update_time': 1774699277.292969, 'auction_closing_time': 1774884678.0}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD48941') HTTP/1.1" 204 0
2026-03-28 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_9f97e03806a0241a51b08e37a57fd09c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec85d0>
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F8b%252Ffc8b2c32f9207a5da90359c3349428db%252Fpa%252FDX51815_50e2501c188ea327792dfbfc92903855.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_50e2501c188ea327792dfbfc92903855.jpg saved to cache
2026-03-28 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99394b93-3aa2-5ad8-b39d-267937e48230
2026-03-28 12:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99394b93-3aa2-5ad8-b39d-267937e48230, skipping ID generation
2026-03-28 12:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99394b93-3aa2-5ad8-b39d-267937e48230 with scrape type 1
2026-03-28 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99394b93-3aa2-5ad8-b39d-267937e48230 sending to next pipeline
2026-03-28 12:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99394b93-3aa2-5ad8-b39d-267937e48230, identifier: DX51815
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacc5d50>
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_87f8434f08a6a9fbf7f015c8d899a654.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_87f8434f08a6a9fbf7f015c8d899a654.jpg saved to cache
2026-03-28 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_b16f7d89ae119f68a5ee059c13651bde.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-28 12:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-28 12:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815 to the API
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_50e2501c188ea327792dfbfc92903855.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:13Z',
 'fuel_type': 'petrol',
 'id': '99394b93-3aa2-5ad8-b39d-267937e48230',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX51815',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 235171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_88682b320b9b4fd0009226047bfbc7ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_27a2bc7005ee4dbbb1b17b5a2ea6a6b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356065,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_50e2501c188ea327792dfbfc92903855.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336175,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_2a38b333f3d1de5cd02fd55a001667b3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_590e8b63404c5d60cca0c818726a685d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141244,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_f5731697e45bbad183dd98144308bd91.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147440,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_e0d5c9b2f0364d9683842ae8071fed83.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99394b93-3aa2-5ad8-b39d-267937e48230/99394b93-3aa2-5ad8-b39d-267937e48230_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136631,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/8b/fc8b2c32f9207a5da90359c3349428db/pa/DX51815_0ef6359e0e8e0a86247b7c8d7c84071e.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-28 12:01:17 [auto1.nl] INFO: Saving data for DX51815: {'created_time': 1774699277.984793, 'last_price_update_time': 1774699277.984805, 'auction_closing_time': 1774885033.0}
2026-03-28 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DX51815') HTTP/1.1" 204 0
2026-03-28 12:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9ab050>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_af55dc8c4d3ee53775ee172279e55dd6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_af55dc8c4d3ee53775ee172279e55dd6.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_592a01f3db281dda6decdb97be70c697.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_1d49ad6727d874f335c7f29a2d0e2df6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_a2e8c5f472b263f506c47af439f73f64.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac56790>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_3007728d11551b157b994ed2c8cbcd40.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3007728d11551b157b994ed2c8cbcd40.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9ad690>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_ccbefb3434b2545ac3bab467f4a52843.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_ccbefb3434b2545ac3bab467f4a52843.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeee0d0>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_c4e9999fc73674ab9d34ff4efb4ba64c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_c4e9999fc73674ab9d34ff4efb4ba64c.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba6a1d0>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_9f97e03806a0241a51b08e37a57fd09c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_9f97e03806a0241a51b08e37a57fd09c.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG49112> (referer: https://www.auto1.com/v1/car-details-view/ZG49112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeec710>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_b16f7d89ae119f68a5ee059c13651bde.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_b16f7d89ae119f68a5ee059c13651bde.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:18 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_e6c3cb2c2b784bb161281f4f67846e3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad2c750>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_592a01f3db281dda6decdb97be70c697.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_592a01f3db281dda6decdb97be70c697.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec7190>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_1d49ad6727d874f335c7f29a2d0e2df6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_1d49ad6727d874f335c7f29a2d0e2df6.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac06d10>
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_a2e8c5f472b263f506c47af439f73f64.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_a2e8c5f472b263f506c47af439f73f64.jpg saved to cache
2026-03-28 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD39656%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for SD39656: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA17330%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for DA17330: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA05511%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for GA05511: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for NR95179: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for WS89953: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA68968%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for AA68968: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY12537%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for AY12537: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA56403%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for SA56403: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP01462%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for CP01462: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZM76247%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for ZM76247: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for FT93592: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF39374%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for YF39374: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for KB15106: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG69964%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for XG69964: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-28 12:01:18 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU59495%27 HTTP/1.1" 200 None
2026-03-28 12:01:18 [auto1.nl] INFO: Scrape type for YU59495: 0
2026-03-28 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3f2e9afd82ccf03d32943f152e379c33.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_f2a52bbf2d5d56b4e18859dd77e43aae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f5a839335d1dfc4e52adf86d6dcc75c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-28 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cfef7af-d3d7-5803-87eb-e023b45625af with scrape type 1
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7cfef7af-d3d7-5803-87eb-e023b45625af
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_18bce08c9f539b001bf7c3a711641849.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_18bce08c9f539b001bf7c3a711641849.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_245edd6770fd3644669b2e5c77040843.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_245edd6770fd3644669b2e5c77040843.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_d41718e9b3e074ca9d1c0e1e6cf72776.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_d41718e9b3e074ca9d1c0e1e6cf72776.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_99d752f279f7a245fecbd4d4c7a2d9bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_99d752f279f7a245fecbd4d4c7a2d9bf.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_1e44958a35fefd6e92b227415d67aa0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_1e44958a35fefd6e92b227415d67aa0a.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_14729308ff7d4e7b7fc6cfb89f39df97.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_14729308ff7d4e7b7fc6cfb89f39df97.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_4d58ebbfccf9cf0eb7c3f45c296c6418.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_4d58ebbfccf9cf0eb7c3f45c296c6418.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_e10a0fd3cba31eb569890cf5725f25a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_e10a0fd3cba31eb569890cf5725f25a7.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_c40b9b04e0611b1f81888cd117918f4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_c40b9b04e0611b1f81888cd117918f4b.jpg already downloaded
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F82%252F3e828ef03c6ded3fbc6dda7c2b55472e%252Fpa%252FZG49112_eb509baad3ec86d053a519a13bcd6200.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_eb509baad3ec86d053a519a13bcd6200.jpg already downloaded
2026-03-28 12:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7cfef7af-d3d7-5803-87eb-e023b45625af, identifier: ZG49112
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9aa790>
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_e6c3cb2c2b784bb161281f4f67846e3e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_e6c3cb2c2b784bb161281f4f67846e3e.jpg saved to cache
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-28 12:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-28 12:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112 to the API
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG49112>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'petrol',
 'id': '7cfef7af-d3d7-5803-87eb-e023b45625af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KZ063V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG49112',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 85608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_18bce08c9f539b001bf7c3a711641849.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_245edd6770fd3644669b2e5c77040843.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_d41718e9b3e074ca9d1c0e1e6cf72776.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_99d752f279f7a245fecbd4d4c7a2d9bf.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_1e44958a35fefd6e92b227415d67aa0a.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_14729308ff7d4e7b7fc6cfb89f39df97.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_4d58ebbfccf9cf0eb7c3f45c296c6418.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_e10a0fd3cba31eb569890cf5725f25a7.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_c40b9b04e0611b1f81888cd117918f4b.jpg',
                'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_eb509baad3ec86d053a519a13bcd6200.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_18bce08c9f539b001bf7c3a711641849.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2166176,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_245edd6770fd3644669b2e5c77040843.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2025971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_d41718e9b3e074ca9d1c0e1e6cf72776.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_99d752f279f7a245fecbd4d4c7a2d9bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2083807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_1e44958a35fefd6e92b227415d67aa0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_14729308ff7d4e7b7fc6cfb89f39df97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_4d58ebbfccf9cf0eb7c3f45c296c6418.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2270118,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_e10a0fd3cba31eb569890cf5725f25a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_c40b9b04e0611b1f81888cd117918f4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cfef7af-d3d7-5803-87eb-e023b45625af/7cfef7af-d3d7-5803-87eb-e023b45625af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2381451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/82/3e828ef03c6ded3fbc6dda7c2b55472e/pa/ZG49112_eb509baad3ec86d053a519a13bcd6200.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-28 12:01:19 [auto1.nl] INFO: Saving data for ZG49112: {'created_time': 1774699279.708487, 'last_price_update_time': 1774699279.708496, 'auction_closing_time': 1774886055.0}
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG49112') HTTP/1.1" 204 0
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_138426808a233e56e05e3260dc17f2ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae03bd0>
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_3f2e9afd82ccf03d32943f152e379c33.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3f2e9afd82ccf03d32943f152e379c33.jpg saved to cache
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_10b736666f2535acd1c542152ff98717.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_f76c752490bbceb7fb3cd6536aa27f6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_c9b1eb975725827093b189c49c269bd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae01c10>
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_f2a52bbf2d5d56b4e18859dd77e43aae.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_f2a52bbf2d5d56b4e18859dd77e43aae.jpg saved to cache
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9a97510>
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_f5a839335d1dfc4e52adf86d6dcc75c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f5a839335d1dfc4e52adf86d6dcc75c6.jpg saved to cache
2026-03-28 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9a0a0d0>
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_138426808a233e56e05e3260dc17f2ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_138426808a233e56e05e3260dc17f2ac.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_564354bf17e9ce866dfc097b858d094c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb9d010>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_10b736666f2535acd1c542152ff98717.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_10b736666f2535acd1c542152ff98717.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ac72c08-1d0a-5646-915f-155391cbd170
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba71250>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_f76c752490bbceb7fb3cd6536aa27f6f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_f76c752490bbceb7fb3cd6536aa27f6f.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbaf9750>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_c9b1eb975725827093b189c49c269bd6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_c9b1eb975725827093b189c49c269bd6.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_472c892924405985e5149de61a24ee37.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_15288b3dd68a5230d94d0705c20acba0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf85150>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_564354bf17e9ce866dfc097b858d094c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_564354bf17e9ce866dfc097b858d094c.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ac72c08-1d0a-5646-915f-155391cbd170
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_65283952288061695c63a9fe9200aad3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_28b6070f19b1324f499d9d46ff2e4d1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_06d0f8588bebc1f27d7faca24d793da2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_51f92a7356a678dfeb215f5baa9c5e65.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_bc0d6409cb5347fa44a2d69a4e1539f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fa78c38fd56052c430631be1a5a8d387.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbeef50>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_472c892924405985e5149de61a24ee37.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_472c892924405985e5149de61a24ee37.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_56c88cffa41f4048503a49bde8f61319.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb85d150>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_15288b3dd68a5230d94d0705c20acba0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_15288b3dd68a5230d94d0705c20acba0.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_1510efe142ddc3a03608dcc5cbc50ec9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafc0150>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_65283952288061695c63a9fe9200aad3.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_65283952288061695c63a9fe9200aad3.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb919550>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bf4942c04f9b1d30cb19b0842f1610%252Fpa%252FNJ12224_28b6070f19b1324f499d9d46ff2e4d1e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_28b6070f19b1324f499d9d46ff2e4d1e.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6225da9c-cd5e-52d7-89f4-e343143e4f34
2026-03-28 12:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6225da9c-cd5e-52d7-89f4-e343143e4f34, skipping ID generation
2026-03-28 12:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6225da9c-cd5e-52d7-89f4-e343143e4f34 with scrape type 1
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6225da9c-cd5e-52d7-89f4-e343143e4f34 sending to next pipeline
2026-03-28 12:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6225da9c-cd5e-52d7-89f4-e343143e4f34, identifier: NJ12224
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9d99350>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_06d0f8588bebc1f27d7faca24d793da2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_06d0f8588bebc1f27d7faca24d793da2.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba722d0>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F4e%252F914ef08a56d7158a02a633d7db2ac22d%252Fpa%252FWZ79997_51f92a7356a678dfeb215f5baa9c5e65.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_51f92a7356a678dfeb215f5baa9c5e65.jpg saved to cache
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67
2026-03-28 12:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67, skipping ID generation
2026-03-28 12:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with scrape type 1
2026-03-28 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 sending to next pipeline
2026-03-28 12:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67, identifier: WZ79997
2026-03-28 12:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb9ef10>
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_bc0d6409cb5347fa44a2d69a4e1539f1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_bc0d6409cb5347fa44a2d69a4e1539f1.jpg saved to cache
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac0b790>
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F22%252F292210750e7bf7b4599f3f9a8efe45e9%252Fpa%252FEU38085_fa78c38fd56052c430631be1a5a8d387.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fa78c38fd56052c430631be1a5a8d387.jpg saved to cache
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f2cef4e-0091-545e-a089-052ef2312c17
2026-03-28 12:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f2cef4e-0091-545e-a089-052ef2312c17, skipping ID generation
2026-03-28 12:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2cef4e-0091-545e-a089-052ef2312c17 with scrape type 1
2026-03-28 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f2cef4e-0091-545e-a089-052ef2312c17 sending to next pipeline
2026-03-28 12:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4f2cef4e-0091-545e-a089-052ef2312c17, identifier: EU38085
2026-03-28 12:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-28 12:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-28 12:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224 to the API
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_28b6070f19b1324f499d9d46ff2e4d1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'diesel',
 'id': '6225da9c-cd5e-52d7-89f4-e343143e4f34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '26GGK1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ12224',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 402077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2220499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_28b6070f19b1324f499d9d46ff2e4d1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_8945e7e17f7c5e1b1ce5ae8b4aca9249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1931357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_65283952288061695c63a9fe9200aad3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_d0c25feb67f62f56f649ebb3f9010c69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_7e193b81333d14b5036bb54b8c44ee54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_f83cf909fa86b3cec5ff43db1dd4a184.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_e5b4160c4e9635e8d4bf57dfee279c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2146199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_138426808a233e56e05e3260dc17f2ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_af55dc8c4d3ee53775ee172279e55dd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225da9c-cd5e-52d7-89f4-e343143e4f34/6225da9c-cd5e-52d7-89f4-e343143e4f34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bf4942c04f9b1d30cb19b0842f1610/pa/NJ12224_9f97e03806a0241a51b08e37a57fd09c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-29',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi Passenger Expression',
 'transmission': 'manual',
 'trim': 'Passenger Expression',
 'year': 2008}
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [auto1.nl] INFO: Saving data for NJ12224: {'created_time': 1774699281.644293, 'last_price_update_time': 1774699281.644304, 'auction_closing_time': 1774884887.0}
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ12224') HTTP/1.1" 204 0
2026-03-28 12:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-28 12:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-28 12:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997 to the API
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_51f92a7356a678dfeb215f5baa9c5e65.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 210,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:29:27Z',
 'fuel_type': 'petrol',
 'id': '5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZL897J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ79997',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 131843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_87f8434f08a6a9fbf7f015c8d899a654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_592a01f3db281dda6decdb97be70c697.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_ccbefb3434b2545ac3bab467f4a52843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3007728d11551b157b994ed2c8cbcd40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_51f92a7356a678dfeb215f5baa9c5e65.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_a2e8c5f472b263f506c47af439f73f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_1d49ad6727d874f335c7f29a2d0e2df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_b16f7d89ae119f68a5ee059c13651bde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_3f2e9afd82ccf03d32943f152e379c33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67/5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/4e/914ef08a56d7158a02a633d7db2ac22d/pa/WZ79997_e6c3cb2c2b784bb161281f4f67846e3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 sDrive 35is',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-28 12:01:21 [auto1.nl] INFO: Saving data for WZ79997: {'created_time': 1774699281.997488, 'last_price_update_time': 1774699281.997498, 'auction_closing_time': 1774884567.0}
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ79997') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-28 12:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-28 12:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085 to the API
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fa78c38fd56052c430631be1a5a8d387.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 254,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:50:57Z',
 'fuel_type': 'diesel',
 'id': '4f2cef4e-0091-545e-a089-052ef2312c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '94GVV2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38085',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 272322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_06d0f8588bebc1f27d7faca24d793da2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3711827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fa78c38fd56052c430631be1a5a8d387.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f5a839335d1dfc4e52adf86d6dcc75c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_a657b796e3b44a51d0c38a27831e73a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3246508,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_902f7c85c973473ad76c6e3a16dbc7ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3222594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_40a3070bd28295c541fd501a4e7ac2fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_f4a598ab9711e4f86899324f3a3cf07b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2946958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_fb8015ede2791aabda17c00b07d17e6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3121548,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_bc0d6409cb5347fa44a2d69a4e1539f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2cef4e-0091-545e-a089-052ef2312c17/4f2cef4e-0091-545e-a089-052ef2312c17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/22/292210750e7bf7b4599f3f9a8efe45e9/pa/EU38085_c4e9999fc73674ab9d34ff4efb4ba64c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 280 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-28 12:01:22 [auto1.nl] INFO: Saving data for EU38085: {'created_time': 1774699282.377658, 'last_price_update_time': 1774699282.377669, 'auction_closing_time': 1774885857.0}
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU38085') HTTP/1.1" 204 0
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_e8bdc1dddfdadf793e7235fa6731a873.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_24860cb1cd0e5495b433a544ed58fefd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_41231a289ca91d4776fe297fb6812b0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP52845> (referer: https://www.auto1.com/v1/car-details-view/BP52845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba6cf10>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_56c88cffa41f4048503a49bde8f61319.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_56c88cffa41f4048503a49bde8f61319.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbae6b10>
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F43%252F47438bfddad0828a3fae105d7e327fe2%252Fpa%252FWN94746_1510efe142ddc3a03608dcc5cbc50ec9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_1510efe142ddc3a03608dcc5cbc50ec9.jpg saved to cache
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ac72c08-1d0a-5646-915f-155391cbd170
2026-03-28 12:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ac72c08-1d0a-5646-915f-155391cbd170, skipping ID generation
2026-03-28 12:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac72c08-1d0a-5646-915f-155391cbd170 with scrape type 1
2026-03-28 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ac72c08-1d0a-5646-915f-155391cbd170 sending to next pipeline
2026-03-28 12:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ac72c08-1d0a-5646-915f-155391cbd170, identifier: WN94746
2026-03-28 12:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-28 12:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-28 12:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746 to the API
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_1510efe142ddc3a03608dcc5cbc50ec9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:21:47Z',
 'fuel_type': 'petrol',
 'id': '2ac72c08-1d0a-5646-915f-155391cbd170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '8TTN86',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN94746',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 253618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_c24e60f8756a18377173b80586099587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_1510efe142ddc3a03608dcc5cbc50ec9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_11138afc2a277d1ec5ccfd0e4af5c27c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_5097fa5ae145f690d6ea0492e45e3566.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_564354bf17e9ce866dfc097b858d094c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac72c08-1d0a-5646-915f-155391cbd170/2ac72c08-1d0a-5646-915f-155391cbd170_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/43/47438bfddad0828a3fae105d7e327fe2/pa/WN94746_10b736666f2535acd1c542152ff98717.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Saving data for WN94746: {'created_time': 1774699283.004934, 'last_price_update_time': 1774699283.004943, 'auction_closing_time': 1774884107.0}
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN94746') HTTP/1.1" 204 0
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad2d6d0>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_e8bdc1dddfdadf793e7235fa6731a873.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_e8bdc1dddfdadf793e7235fa6731a873.jpg saved to cache
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec5a10>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_24860cb1cd0e5495b433a544ed58fefd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_24860cb1cd0e5495b433a544ed58fefd.jpg saved to cache
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9aad10>
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ffd%252F9afde37a42fe75984105e2e0a8d4e1e3%252Fpa%252FJF84007_41231a289ca91d4776fe297fb6812b0e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_41231a289ca91d4776fe297fb6812b0e.jpg saved to cache
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99a0e11b-1e01-5d26-84aa-8887a06e5405
2026-03-28 12:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99a0e11b-1e01-5d26-84aa-8887a06e5405, skipping ID generation
2026-03-28 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a0e11b-1e01-5d26-84aa-8887a06e5405 with scrape type 1
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99a0e11b-1e01-5d26-84aa-8887a06e5405 sending to next pipeline
2026-03-28 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99a0e11b-1e01-5d26-84aa-8887a06e5405, identifier: JF84007
2026-03-28 12:01:23 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-28 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with scrape type 1
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_9dd873a3c3b92fad53fcd55a177a4c69.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_9dd873a3c3b92fad53fcd55a177a4c69.jpg not downloaded yet
2026-03-28 12:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-28 12:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-28 12:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007 to the API
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_41231a289ca91d4776fe297fb6812b0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'petrol',
 'id': '99a0e11b-1e01-5d26-84aa-8887a06e5405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HV-774-B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF84007',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'Fiat',
 'model': '500',
 'odometer': 75581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cef6ab63d91b21272f42faaa148a2335.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_41231a289ca91d4776fe297fb6812b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_24860cb1cd0e5495b433a544ed58fefd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_e8bdc1dddfdadf793e7235fa6731a873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_15288b3dd68a5230d94d0705c20acba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_c9b1eb975725827093b189c49c269bd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_f2a52bbf2d5d56b4e18859dd77e43aae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_cde1ef63b07b1a48afd4bcbb308f05bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3514143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_85efeea4bdaf7c2e365439df9822932d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a0e11b-1e01-5d26-84aa-8887a06e5405/99a0e11b-1e01-5d26-84aa-8887a06e5405_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/fd/9afde37a42fe75984105e2e0a8d4e1e3/pa/JF84007_2bf7cb2c3da592347f7581f245013933.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 0.9 Pop',
 'transmission': 'automatic',
 'trim': 'Pop',
 'year': 2015}
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Saving data for JF84007: {'created_time': 1774699283.644347, 'last_price_update_time': 1774699283.644356, 'auction_closing_time': 1774883114.0}
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF84007') HTTP/1.1" 204 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for EA94129: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR01730%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for JR01730: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ61661%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for JJ61661: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK25571%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for YK25571: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for NU05681: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR57871%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for NR57871: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH03360%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for CH03360: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ79748%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for KZ79748: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY38299%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for XY38299: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD45630%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for TD45630: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS00430%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for GS00430: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for VS32339: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH26666%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for FH26666: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT03654%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for ZT03654: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ41839%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for EZ41839: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT38970%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for GT38970: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-28 12:01:23 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-28 12:01:23 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-28 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [auto1.nl] INFO: Scrape type for DV35318: 0
2026-03-28 12:01:24 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-28 12:01:24 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR09014%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [auto1.nl] INFO: Scrape type for KR09014: 0
2026-03-28 12:01:24 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ17478%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [auto1.nl] INFO: Scrape type for BZ17478: 0
2026-03-28 12:01:24 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-28 12:01:24 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-28 12:01:24 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA42645%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [auto1.nl] INFO: Scrape type for FA42645: 0
2026-03-28 12:01:24 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ53353%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [auto1.nl] INFO: Scrape type for GJ53353: 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_d2e7ed69f30401f3a7f5ba07137955ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_d2e7ed69f30401f3a7f5ba07137955ee.jpg not downloaded yet
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_67dd638b414d42b99290f0c946d7ed54.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_ce24686e78617db51091170f7fd7e434.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_958291d42fac88712e4810619eb55ad7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_1dbdc68fb96eeeacfc43ee2c05bb5827.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW25859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_b260b90909f6552054cfccea3ff30cdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_b260b90909f6552054cfccea3ff30cdd.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_2a0994b3fe4a5eac6d8a20e6d635f5db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_2a0994b3fe4a5eac6d8a20e6d635f5db.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_53923d9f20d911bd973e2d3a0b6e2971.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_53923d9f20d911bd973e2d3a0b6e2971.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_c990da6e6e9b3e04cbbffb0308068381.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_c990da6e6e9b3e04cbbffb0308068381.jpg not downloaded yet
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_e96f0885be301f2b4d65e6f75be711b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_56a4fe330dcca50989c566abfe7d6c47.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_56a4fe330dcca50989c566abfe7d6c47.jpg not downloaded yet
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_518eca40b4f932e0662884d37e9bb891.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_518eca40b4f932e0662884d37e9bb891.jpg not downloaded yet
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caccdc90>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_67dd638b414d42b99290f0c946d7ed54.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_67dd638b414d42b99290f0c946d7ed54.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9dde90>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_ce24686e78617db51091170f7fd7e434.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_ce24686e78617db51091170f7fd7e434.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae34d10>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_958291d42fac88712e4810619eb55ad7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_958291d42fac88712e4810619eb55ad7.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9ad650>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_1dbdc68fb96eeeacfc43ee2c05bb5827.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_1dbdc68fb96eeeacfc43ee2c05bb5827.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_e82a5d38bab92ec10f39568089ae95f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_e4dd9b28f0d5a32828158e217c21900a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_db2ef770fbbd34046e96d1b3675d69ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9c0806affb2111898d45005ecce882b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec8290>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_e96f0885be301f2b4d65e6f75be711b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_e96f0885be301f2b4d65e6f75be711b5.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_35227b304d321d84873672664d9424f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_d2e7ed69f30401f3a7f5ba07137955ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_9dd873a3c3b92fad53fcd55a177a4c69.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_5f2dbb5e5f832e327e2316420a6c3aa8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_dd56ae221a0475c1346f4a2df9864c12.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_0f1dce121e92c984d7efdbe19c679b5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_3b6f4e5848254ab61a302db934046e77.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_56a4fe330dcca50989c566abfe7d6c47.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cabf8490>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_e82a5d38bab92ec10f39568089ae95f9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_e82a5d38bab92ec10f39568089ae95f9.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf16690>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_e4dd9b28f0d5a32828158e217c21900a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_e4dd9b28f0d5a32828158e217c21900a.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_518eca40b4f932e0662884d37e9bb891.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_b260b90909f6552054cfccea3ff30cdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5d60240edb124fabee092db462cd2568.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_c990da6e6e9b3e04cbbffb0308068381.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_53923d9f20d911bd973e2d3a0b6e2971.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad69510>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_db2ef770fbbd34046e96d1b3675d69ea.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_db2ef770fbbd34046e96d1b3675d69ea.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba9c990>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_9c0806affb2111898d45005ecce882b2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9c0806affb2111898d45005ecce882b2.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9cbf050>
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fde%252F80def2ce4f5e209c612480b2cd7c8e2f%252Fpa%252FDJ46393_35227b304d321d84873672664d9424f5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_35227b304d321d84873672664d9424f5.jpg saved to cache
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345
2026-03-28 12:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345, skipping ID generation
2026-03-28 12:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with scrape type 1
2026-03-28 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 sending to next pipeline
2026-03-28 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345, identifier: DJ46393
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b5390>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_d2e7ed69f30401f3a7f5ba07137955ee.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_d2e7ed69f30401f3a7f5ba07137955ee.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac159d0>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_9dd873a3c3b92fad53fcd55a177a4c69.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_9dd873a3c3b92fad53fcd55a177a4c69.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae01d50>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_5f2dbb5e5f832e327e2316420a6c3aa8.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_5f2dbb5e5f832e327e2316420a6c3aa8.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba738d0>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_dd56ae221a0475c1346f4a2df9864c12.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_dd56ae221a0475c1346f4a2df9864c12.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d99ebb50>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_0f1dce121e92c984d7efdbe19c679b5d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_0f1dce121e92c984d7efdbe19c679b5d.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fd23808-ff64-5851-853c-f5825419ed70
2026-03-28 12:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae09210>
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_3b6f4e5848254ab61a302db934046e77.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_3b6f4e5848254ab61a302db934046e77.jpg saved to cache
2026-03-28 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-28 12:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-28 12:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393 to the API
2026-03-28 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_35227b304d321d84873672664d9424f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:28:42Z',
 'fuel_type': 'petrol',
 'id': '51840e3b-06c3-5d43-a9f2-5efdc8c8c345',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JG201R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ46393',
 'listing': 'auction',
 'location': 'NL, Goes',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 102422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_0fc6185e1b04d2ae578616c652cb85e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2034136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_35227b304d321d84873672664d9424f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_3b978a6170c500bb667a612978e3c095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_52095addfc63041c92593a4935efb04f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_472c892924405985e5149de61a24ee37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_f76c752490bbceb7fb3cd6536aa27f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_1e4dd8fc19ff1a6e93dfd558547dff49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4997fb4d488ba8d0d53de5d387385c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_cc68853c92639ba415fe9a5bf7adb50e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51840e3b-06c3-5d43-a9f2-5efdc8c8c345/51840e3b-06c3-5d43-a9f2-5efdc8c8c345_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/de/80def2ce4f5e209c612480b2cd7c8e2f/pa/DJ46393_4acdaa50d55b4b5d2c6d0242f44e2a60.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [auto1.nl] INFO: Saving data for DJ46393: {'created_time': 1774699286.145627, 'last_price_update_time': 1774699286.145636, 'auction_closing_time': 1774884522.0}
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ46393') HTTP/1.1" 204 0
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_761ba7743f1800bf87fbf85e64722178.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac54f50>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_56a4fe330dcca50989c566abfe7d6c47.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_56a4fe330dcca50989c566abfe7d6c47.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_2a0994b3fe4a5eac6d8a20e6d635f5db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB32456/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae84150>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_518eca40b4f932e0662884d37e9bb891.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_518eca40b4f932e0662884d37e9bb891.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf4b810>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_b260b90909f6552054cfccea3ff30cdd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_b260b90909f6552054cfccea3ff30cdd.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb80d950>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F47%252F3647e28d6fb6e1cd2942eaabc8caa0f9%252Fpa%252FMZ09465_5d60240edb124fabee092db462cd2568.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5d60240edb124fabee092db462cd2568.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 426a13f9-a2cd-50b3-b345-1f62e662d16a
2026-03-28 12:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 426a13f9-a2cd-50b3-b345-1f62e662d16a, skipping ID generation
2026-03-28 12:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 426a13f9-a2cd-50b3-b345-1f62e662d16a with scrape type 1
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 426a13f9-a2cd-50b3-b345-1f62e662d16a sending to next pipeline
2026-03-28 12:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 426a13f9-a2cd-50b3-b345-1f62e662d16a, identifier: MZ09465
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae4dfd0>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_c990da6e6e9b3e04cbbffb0308068381.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_c990da6e6e9b3e04cbbffb0308068381.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb91b4d0>
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_53923d9f20d911bd973e2d3a0b6e2971.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_53923d9f20d911bd973e2d3a0b6e2971.jpg saved to cache
2026-03-28 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465
2026-03-28 12:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465
2026-03-28 12:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465 to the API
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5d60240edb124fabee092db462cd2568.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:59:14Z',
 'fuel_type': 'petrol',
 'id': '426a13f9-a2cd-50b3-b345-1f62e662d16a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '76NNS4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ09465',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 188410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5d60240edb124fabee092db462cd2568.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_db2ef770fbbd34046e96d1b3675d69ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_56c88cffa41f4048503a49bde8f61319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_3ea3ace75c00fc1a474060ec614740a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_a1c009d0dabee9ea755f440f7f3b08bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_38978a1563448ea64414dcb9bbc6f9ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c0eb5bdc6cd4fe980f57ac83893386f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_5312d5ff00e9f83f7d301bfeae8044e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_430f9e70c3d7ddf20c0f67148fdc7296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_426a13f9-a2cd-50b3-b345-1f62e662d16a/426a13f9-a2cd-50b3-b345-1f62e662d16a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/47/3647e28d6fb6e1cd2942eaabc8caa0f9/pa/MZ09465_c268dcc20e80ab8f391ef21daea5ce47.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.8 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2010}
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-28 12:01:26 [auto1.nl] INFO: Saving data for MZ09465: {'created_time': 1774699286.986207, 'last_price_update_time': 1774699286.986219, 'auction_closing_time': 1774886354.0}
2026-03-28 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ09465') HTTP/1.1" 204 0
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_49a420588fb313928fc45816e6069367.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_7261c388864ae9e7b631038a8a6432be.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_cc9650711d5504e1c2805c6d812283ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_736ade5bc86ed9bb80604e484d0d1766.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_34dcc940d2359aea64c530c24ed223fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9ca4510>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_761ba7743f1800bf87fbf85e64722178.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_761ba7743f1800bf87fbf85e64722178.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbc7150>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fb3%252Ffcb33839d9d012fc67a2d8ad1ecdf196%252Fpa%252FBP52845_2a0994b3fe4a5eac6d8a20e6d635f5db.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_2a0994b3fe4a5eac6d8a20e6d635f5db.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4
2026-03-28 12:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83fb62fd-c291-5280-8113-1b0eaf1e77f4, skipping ID generation
2026-03-28 12:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with scrape type 1
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4 sending to next pipeline
2026-03-28 12:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83fb62fd-c291-5280-8113-1b0eaf1e77f4, identifier: BP52845
2026-03-28 12:01:27 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-28 12:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-28 12:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845 to the API
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_2a0994b3fe4a5eac6d8a20e6d635f5db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 441,
 'expiration_date': '2026-03-30T15:53:11Z',
 'fuel_type': 'electro',
 'id': '83fb62fd-c291-5280-8113-1b0eaf1e77f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP52845',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 184012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_9dd873a3c3b92fad53fcd55a177a4c69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_d2e7ed69f30401f3a7f5ba07137955ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218080,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_b260b90909f6552054cfccea3ff30cdd.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248580,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_2a0994b3fe4a5eac6d8a20e6d635f5db.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213945,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_53923d9f20d911bd973e2d3a0b6e2971.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193021,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_c990da6e6e9b3e04cbbffb0308068381.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_56a4fe330dcca50989c566abfe7d6c47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83fb62fd-c291-5280-8113-1b0eaf1e77f4/83fb62fd-c291-5280-8113-1b0eaf1e77f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/b3/fcb33839d9d012fc67a2d8ad1ecdf196/pa/BP52845_518eca40b4f932e0662884d37e9bb891.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Long Range Dual AWD AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2019}
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Saving data for BP52845: {'created_time': 1774699287.566571, 'last_price_update_time': 1774699287.566581, 'auction_closing_time': 1774885991.0}
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP52845') HTTP/1.1" 204 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ83139%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for ZZ83139: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX18772%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for VX18772: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16373%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for HT16373: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN57581%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for LN57581: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC36011%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for MC36011: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR79727%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for WR79727: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT33504%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for CT33504: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG05474%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for PG05474: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for ZY63395: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for VW91946: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC20329%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for HC20329: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN01691%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for CN01691: 0
2026-03-28 12:01:27 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL96236%27 HTTP/1.1" 200 None
2026-03-28 12:01:27 [auto1.nl] INFO: Scrape type for ZL96236: 0
2026-03-28 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW25859> (referer: https://www.auto1.com/v1/car-details-view/WW25859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb98a7d0>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_49a420588fb313928fc45816e6069367.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_49a420588fb313928fc45816e6069367.jpg saved to cache
2026-03-28 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad68510>
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_7261c388864ae9e7b631038a8a6432be.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_7261c388864ae9e7b631038a8a6432be.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fd23808-ff64-5851-853c-f5825419ed70
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb987290>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F94%252F8d94feee0b3bb7c047e3ce6aadbc8c1c%252Fpa%252FUV97115_cc9650711d5504e1c2805c6d812283ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_cc9650711d5504e1c2805c6d812283ff.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 606068ae-7bcd-5d60-8159-09e17b7dba03
2026-03-28 12:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 606068ae-7bcd-5d60-8159-09e17b7dba03, skipping ID generation
2026-03-28 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606068ae-7bcd-5d60-8159-09e17b7dba03 with scrape type 1
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 606068ae-7bcd-5d60-8159-09e17b7dba03 sending to next pipeline
2026-03-28 12:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 606068ae-7bcd-5d60-8159-09e17b7dba03, identifier: UV97115
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac0a290>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_736ade5bc86ed9bb80604e484d0d1766.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_736ade5bc86ed9bb80604e484d0d1766.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacdd990>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_34dcc940d2359aea64c530c24ed223fa.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_34dcc940d2359aea64c530c24ed223fa.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_a9291ed4813591ff903530d242b573a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_5ce7e9d593bbad69430e86c2947fd8fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_8a948cf7da9389c1ec123f61ca67ef72.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 606068ae-7bcd-5d60-8159-09e17b7dba03 with identifier: UV97115
2026-03-28 12:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 606068ae-7bcd-5d60-8159-09e17b7dba03 with identifier: UV97115
2026-03-28 12:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 606068ae-7bcd-5d60-8159-09e17b7dba03 with identifier: UV97115 to the API
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_cc9650711d5504e1c2805c6d812283ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:25:02Z',
 'fuel_type': 'petrol',
 'id': '606068ae-7bcd-5d60-8159-09e17b7dba03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '71ZDHR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV97115',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 158317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_cc9650711d5504e1c2805c6d812283ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_49a420588fb313928fc45816e6069367.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_e82a5d38bab92ec10f39568089ae95f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_3b6f4e5848254ab61a302db934046e77.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_2379eea96d2a42de10bcfee8a90dd606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2639814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_936d4507b283041d7f33e64e6687e1fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_a76ca7c4807a74918f7c6726863070e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_70aacfe267003da2d72f950fe9cf3456.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_bd144983034541a0be26bfd87fdb16cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606068ae-7bcd-5d60-8159-09e17b7dba03/606068ae-7bcd-5d60-8159-09e17b7dba03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/94/8d94feee0b3bb7c047e3ce6aadbc8c1c/pa/UV97115_4de141f33064d3277608bd1bda2f1dc4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TFSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2005}
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV97115%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [auto1.nl] INFO: Saving data for UV97115: {'created_time': 1774699288.602776, 'last_price_update_time': 1774699288.602784, 'auction_closing_time': 1774884302.0}
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UV97115') HTTP/1.1" 204 0
2026-03-28 12:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY17438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS54708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859
2026-03-28 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ed755c-0c67-5275-b6c1-398420ac03ee with scrape type 1
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 52ed755c-0c67-5275-b6c1-398420ac03ee
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_7f0f895395af7fbeda610de473057266.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_7f0f895395af7fbeda610de473057266.jpg not downloaded yet
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8f50d0>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_a9291ed4813591ff903530d242b573a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_a9291ed4813591ff903530d242b573a6.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fd23808-ff64-5851-853c-f5825419ed70
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac54510>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_5ce7e9d593bbad69430e86c2947fd8fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_5ce7e9d593bbad69430e86c2947fd8fc.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad13e50>
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_8a948cf7da9389c1ec123f61ca67ef72.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_8a948cf7da9389c1ec123f61ca67ef72.jpg saved to cache
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_cab9cc733f0e094ce475174a9dc77b75.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_cab9cc733f0e094ce475174a9dc77b75.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_18d29fc7ba389c54966bc0c217d612fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_8c7b37e54380b0373955fac29a14a147.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_8c7b37e54380b0373955fac29a14a147.jpg not downloaded yet
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_ef0af606f29e58e19ccebea6c9064f02.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_ef0af606f29e58e19ccebea6c9064f02.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_3c8da44a34c1fb22b45bd14fed9f0daf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_e4f0ca00decf11bd9c0ce29566ac0d18.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_e4f0ca00decf11bd9c0ce29566ac0d18.jpg not downloaded yet
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_323155f586effcdd03363e0239fea1c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_07295f8c742a97958ea069a94006c6f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_b809fd84bbe7671c09f2c03513b44acb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_b809fd84bbe7671c09f2c03513b44acb.jpg not downloaded yet
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_2656821f170e24e00b5dca9ce63e447c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_7f0f895395af7fbeda610de473057266.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_e0604f947c9091ad010002ecf6628f57.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9dc210>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_18d29fc7ba389c54966bc0c217d612fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_18d29fc7ba389c54966bc0c217d612fc.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fd23808-ff64-5851-853c-f5825419ed70
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_225499c1fb5c6396c5f080b8ee9668bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d5c80e5d69696e388ecdcce233ddec91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_f15ac90942b52f1c712b427620dff85f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae65510>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_3c8da44a34c1fb22b45bd14fed9f0daf.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_3c8da44a34c1fb22b45bd14fed9f0daf.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_4658a4c5c59f1b3aa91b37b3c1347f3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbabd990>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_323155f586effcdd03363e0239fea1c2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_323155f586effcdd03363e0239fea1c2.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cabeb950>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4e%252F194eff2e6ffd9b61405c8c80f58e5476%252Fpa%252FSS74343_07295f8c742a97958ea069a94006c6f7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_07295f8c742a97958ea069a94006c6f7.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70
2026-03-28 12:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70, skipping ID generation
2026-03-28 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with scrape type 1
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 sending to next pipeline
2026-03-28 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70, identifier: SS74343
2026-03-28 12:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343
2026-03-28 12:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343
2026-03-28 12:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343 to the API
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_07295f8c742a97958ea069a94006c6f7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:21Z',
 'fuel_type': 'petrol',
 'id': '555c30f3-d3a7-5ff0-85ac-178ad0e69d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '02XFPG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS74343',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 117641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_07295f8c742a97958ea069a94006c6f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_0fd14130ecf0a21791b892fea764bc18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_34dcc940d2359aea64c530c24ed223fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_736ade5bc86ed9bb80604e484d0d1766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_e96f0885be301f2b4d65e6f75be711b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555c30f3-d3a7-5ff0-85ac-178ad0e69d70/555c30f3-d3a7-5ff0-85ac-178ad0e69d70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/4e/194eff2e6ffd9b61405c8c80f58e5476/pa/SS74343_67dd638b414d42b99290f0c946d7ed54.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2007}
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-28 12:01:29 [auto1.nl] INFO: Saving data for SS74343: {'created_time': 1774699289.666438, 'last_price_update_time': 1774699289.666449, 'auction_closing_time': 1774884921.0}
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS74343') HTTP/1.1" 204 0
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_e4f0ca00decf11bd9c0ce29566ac0d18.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_b809fd84bbe7671c09f2c03513b44acb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_ef0af606f29e58e19ccebea6c9064f02.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_8c7b37e54380b0373955fac29a14a147.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU92994/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX92525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec6a90>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_2656821f170e24e00b5dca9ce63e447c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_2656821f170e24e00b5dca9ce63e447c.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb85e810>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_7f0f895395af7fbeda610de473057266.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_7f0f895395af7fbeda610de473057266.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52ed755c-0c67-5275-b6c1-398420ac03ee
2026-03-28 12:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9884d0>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_e0604f947c9091ad010002ecf6628f57.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_e0604f947c9091ad010002ecf6628f57.jpg saved to cache
2026-03-28 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacdc810>
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_225499c1fb5c6396c5f080b8ee9668bf.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_225499c1fb5c6396c5f080b8ee9668bf.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9927d0>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_d5c80e5d69696e388ecdcce233ddec91.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d5c80e5d69696e388ecdcce233ddec91.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9926d0>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F98%252F1f98cc389b74a6ce89fc08bc0d50643f%252Fpa%252FWE18316_f15ac90942b52f1c712b427620dff85f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_f15ac90942b52f1c712b427620dff85f.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b
2026-03-28 12:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1386a4f0-7c91-5d56-9a22-08d976b0d64b, skipping ID generation
2026-03-28 12:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b with scrape type 1
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b sending to next pipeline
2026-03-28 12:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1386a4f0-7c91-5d56-9a22-08d976b0d64b, identifier: WE18316
2026-03-28 12:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae377d0>
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_4658a4c5c59f1b3aa91b37b3c1347f3b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_4658a4c5c59f1b3aa91b37b3c1347f3b.jpg saved to cache
2026-03-28 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316
2026-03-28 12:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316
2026-03-28 12:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316 to the API
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_f15ac90942b52f1c712b427620dff85f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:40:06Z',
 'fuel_type': 'electro',
 'id': '1386a4f0-7c91-5d56-9a22-08d976b0d64b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'G444tb',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE18316',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 148029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_2656821f170e24e00b5dca9ce63e447c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_f15ac90942b52f1c712b427620dff85f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_8a948cf7da9389c1ec123f61ca67ef72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_225499c1fb5c6396c5f080b8ee9668bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_e4dd9b28f0d5a32828158e217c21900a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_1dbdc68fb96eeeacfc43ee2c05bb5827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3718a4d9e62a8cebecabb7e8d61a70ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_d745a60d72cc1f12f223606b94b20e6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2581165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_3702281608a06679f1d6bf4a558dd0f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1386a4f0-7c91-5d56-9a22-08d976b0d64b/1386a4f0-7c91-5d56-9a22-08d976b0d64b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/98/1f98cc389b74a6ce89fc08bc0d50643f/pa/WE18316_af0ddd1602a4c3a45f3185567fc85d7c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2019}
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-28 12:01:31 [auto1.nl] INFO: Saving data for WE18316: {'created_time': 1774699291.021438, 'last_price_update_time': 1774699291.021452, 'auction_closing_time': 1774885206.0}
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WE18316') HTTP/1.1" 204 0
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d61faea5f41fa1315fdb12fe10de111f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY17438> (referer: https://www.auto1.com/v1/car-details-view/WY17438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS54708> (referer: https://www.auto1.com/v1/car-details-view/ZS54708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB32456> (referer: https://www.auto1.com/v1/car-details-view/BB32456/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacde090>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_e4f0ca00decf11bd9c0ce29566ac0d18.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_e4f0ca00decf11bd9c0ce29566ac0d18.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52ed755c-0c67-5275-b6c1-398420ac03ee
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac939d0>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_b809fd84bbe7671c09f2c03513b44acb.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_b809fd84bbe7671c09f2c03513b44acb.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52ed755c-0c67-5275-b6c1-398420ac03ee
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caccc0d0>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_ef0af606f29e58e19ccebea6c9064f02.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_ef0af606f29e58e19ccebea6c9064f02.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52ed755c-0c67-5275-b6c1-398420ac03ee
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb85e050>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_8c7b37e54380b0373955fac29a14a147.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_8c7b37e54380b0373955fac29a14a147.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52ed755c-0c67-5275-b6c1-398420ac03ee
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb80c690>
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd4%252Fc6d4165777ef23726139d6cec00ba2fe%252Fpa%252FXH80509_d61faea5f41fa1315fdb12fe10de111f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d61faea5f41fa1315fdb12fe10de111f.jpg saved to cache
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b26de1a-f963-5b9a-8aac-8f401962dc78
2026-03-28 12:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b26de1a-f963-5b9a-8aac-8f401962dc78, skipping ID generation
2026-03-28 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b26de1a-f963-5b9a-8aac-8f401962dc78 with scrape type 1
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b26de1a-f963-5b9a-8aac-8f401962dc78 sending to next pipeline
2026-03-28 12:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0b26de1a-f963-5b9a-8aac-8f401962dc78, identifier: XH80509
2026-03-28 12:01:31 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438
2026-03-28 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c2a98f-817f-50d9-9776-aee4fe773a4f with scrape type 1
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_f88910af193d37e5cd3a49914d6dd42a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f88910af193d37e5cd3a49914d6dd42a.jpg not downloaded yet
2026-03-28 12:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708
2026-03-28 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with scrape type 1
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_d0cfe397f969a59ed059911e163c6547.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_d0cfe397f969a59ed059911e163c6547.jpg not downloaded yet
2026-03-28 12:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456
2026-03-28 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977d1786-000a-57ea-a389-213e0bc4dc9f with scrape type 1
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_03ac0cbc36edbc455e73091ef4fca055.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_03ac0cbc36edbc455e73091ef4fca055.jpg not downloaded yet
2026-03-28 12:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509
2026-03-28 12:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509
2026-03-28 12:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509 to the API
2026-03-28 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d61faea5f41fa1315fdb12fe10de111f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:09Z',
 'fuel_type': 'petrol',
 'id': '0b26de1a-f963-5b9a-8aac-8f401962dc78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JV-314-V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH80509',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 125622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d5c80e5d69696e388ecdcce233ddec91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_323155f586effcdd03363e0239fea1c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3423719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_d61faea5f41fa1315fdb12fe10de111f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_e0604f947c9091ad010002ecf6628f57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9c0806affb2111898d45005ecce882b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_958291d42fac88712e4810619eb55ad7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2673216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_5f2dbb5e5f832e327e2316420a6c3aa8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_836c87de11db47fb35b8b5fd945b6e5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3221122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_9fb8c0d63ca48471e6d4f5eb8013557a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b26de1a-f963-5b9a-8aac-8f401962dc78/0b26de1a-f963-5b9a-8aac-8f401962dc78_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d4/c6d4165777ef23726139d6cec00ba2fe/pa/XH80509_826ad4d5252104e9fbaeeaa65f2028b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-28 12:01:32 [auto1.nl] INFO: Saving data for XH80509: {'created_time': 1774699292.929599, 'last_price_update_time': 1774699292.929611, 'auction_closing_time': 1774884429.0}
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XH80509') HTTP/1.1" 204 0
2026-03-28 12:01:32 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX67409%27 HTTP/1.1" 200 None
2026-03-28 12:01:32 [auto1.nl] INFO: Scrape type for JX67409: 0
2026-03-28 12:01:32 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-28 12:01:32 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-28 12:01:32 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF79856%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for BF79856: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP19214%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for WP19214: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN68466%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for KN68466: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW65450%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for DW65450: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for RL18676: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS82099%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for XS82099: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for BF50619: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK19053%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for JK19053: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC72456%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for GC72456: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY67553%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for HY67553: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM38195%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for KM38195: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT29313%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for YT29313: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-28 12:01:33 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_2439bd5064dcba3e5aa7b4df2c1e2df5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2439bd5064dcba3e5aa7b4df2c1e2df5.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_ca9b1afa4d6ae892325419ecb80b001d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_ca9b1afa4d6ae892325419ecb80b001d.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_3b56e3d20ba83508c8bc9f4aea37d8c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_3b56e3d20ba83508c8bc9f4aea37d8c0.jpg not downloaded yet
2026-03-28 12:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_697214f3288e8b6e224a9055cc52e622.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_cab9cc733f0e094ce475174a9dc77b75.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_728d58a143c590f976d8b1b4ccf57cbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_728d58a143c590f976d8b1b4ccf57cbe.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_21f1f8e9a009a6afb33f0185a2f1e347.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_21f1f8e9a009a6afb33f0185a2f1e347.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_e63108e4ef3096badba14277420562e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_e63108e4ef3096badba14277420562e1.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_2f4b7585ee6487653677616231dea7fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2f4b7585ee6487653677616231dea7fc.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_1e04f5b3860b26a9aa50ea29bab7be98.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_1e04f5b3860b26a9aa50ea29bab7be98.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_ad791a8733c0a9c238a02d5fc1d0707a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_ad791a8733c0a9c238a02d5fc1d0707a.jpg not downloaded yet
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f88910af193d37e5cd3a49914d6dd42a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_d0cfe397f969a59ed059911e163c6547.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_67b149c1f569725271a04f556e4febd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_67b149c1f569725271a04f556e4febd9.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_c59902f36ee1e711a84f96407e82a5c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_c59902f36ee1e711a84f96407e82a5c6.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_df122fa04fad244c755b2bef5ca90512.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_df122fa04fad244c755b2bef5ca90512.jpg not downloaded yet
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf3c190>
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fcb%252F08cb89bd66684d26a375d31a75014ffa%252Fpa%252FPK76759_697214f3288e8b6e224a9055cc52e622.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_697214f3288e8b6e224a9055cc52e622.jpg saved to cache
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fd23808-ff64-5851-853c-f5825419ed70
2026-03-28 12:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fd23808-ff64-5851-853c-f5825419ed70, skipping ID generation
2026-03-28 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd23808-ff64-5851-853c-f5825419ed70 with scrape type 1
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fd23808-ff64-5851-853c-f5825419ed70 sending to next pipeline
2026-03-28 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4fd23808-ff64-5851-853c-f5825419ed70, identifier: PK76759
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf071d0>
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F50%252F7550031beac4d375293d1b42900b23fb%252Fpa%252FWW25859_cab9cc733f0e094ce475174a9dc77b75.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_cab9cc733f0e094ce475174a9dc77b75.jpg saved to cache
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52ed755c-0c67-5275-b6c1-398420ac03ee
2026-03-28 12:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52ed755c-0c67-5275-b6c1-398420ac03ee, skipping ID generation
2026-03-28 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ed755c-0c67-5275-b6c1-398420ac03ee with scrape type 1
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52ed755c-0c67-5275-b6c1-398420ac03ee sending to next pipeline
2026-03-28 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 52ed755c-0c67-5275-b6c1-398420ac03ee, identifier: WW25859
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_5e2c694fb9007b5a81e4f47d69d287be.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_5e2c694fb9007b5a81e4f47d69d287be.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_9828bd9680f008515a7a01c794137ef1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_9828bd9680f008515a7a01c794137ef1.jpg not downloaded yet
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_54bda4d3b2882a86186ccc162e936f8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_54bda4d3b2882a86186ccc162e936f8c.jpg not downloaded yet
2026-03-28 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759
2026-03-28 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759
2026-03-28 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759 to the API
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_697214f3288e8b6e224a9055cc52e622.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 304,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.3L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:52:10Z',
 'fuel_type': 'petrol',
 'id': '4fd23808-ff64-5851-853c-f5825419ed70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '66ZDPR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK76759',
 'listing': 'auction',
 'location': 'NL, Vianen',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 219918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_697214f3288e8b6e224a9055cc52e622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_18d29fc7ba389c54966bc0c217d612fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_a9291ed4813591ff903530d242b573a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_7261c388864ae9e7b631038a8a6432be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd23808-ff64-5851-853c-f5825419ed70/4fd23808-ff64-5851-853c-f5825419ed70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/cb/08cb89bd66684d26a375d31a75014ffa/pa/PK76759_0f1dce121e92c984d7efdbe19c679b5d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 V6 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2008}
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [auto1.nl] INFO: Saving data for PK76759: {'created_time': 1774699294.295042, 'last_price_update_time': 1774699294.29505, 'auction_closing_time': 1774885930.0}
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK76759') HTTP/1.1" 204 0
2026-03-28 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859
2026-03-28 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859
2026-03-28 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859 to the API
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_cab9cc733f0e094ce475174a9dc77b75.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 2',
 'engine': '1.2L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:14:39Z',
 'fuel_type': 'petrol',
 'id': '52ed755c-0c67-5275-b6c1-398420ac03ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '87-FF-HX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW25859',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 116526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_7f0f895395af7fbeda610de473057266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_cab9cc733f0e094ce475174a9dc77b75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_8c7b37e54380b0373955fac29a14a147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_ef0af606f29e58e19ccebea6c9064f02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_e4f0ca00decf11bd9c0ce29566ac0d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ed755c-0c67-5275-b6c1-398420ac03ee/52ed755c-0c67-5275-b6c1-398420ac03ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/50/7550031beac4d375293d1b42900b23fb/pa/WW25859_b809fd84bbe7671c09f2c03513b44acb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-03-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Viva',
 'transmission': 'manual',
 'trim': 'Viva',
 'year': 2000}
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [auto1.nl] INFO: Saving data for WW25859: {'created_time': 1774699294.793767, 'last_price_update_time': 1774699294.793779, 'auction_closing_time': 1774883679.0}
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WW25859') HTTP/1.1" 204 0
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_e63108e4ef3096badba14277420562e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_21f1f8e9a009a6afb33f0185a2f1e347.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_ad791a8733c0a9c238a02d5fc1d0707a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_f326aa232e9222c109866e71b8e83867.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f326aa232e9222c109866e71b8e83867.jpg not downloaded yet
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_b8b40f2ebace661f25862cf5fc92e118.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_b8b40f2ebace661f25862cf5fc92e118.jpg not downloaded yet
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_493b237f8570e7269965d7bed800146a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_493b237f8570e7269965d7bed800146a.jpg not downloaded yet
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU92994> (referer: https://www.auto1.com/v1/car-details-view/UU92994/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX92525> (referer: https://www.auto1.com/v1/car-details-view/KX92525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY08351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH76205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN27243/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA80107/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbafa490>
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_f88910af193d37e5cd3a49914d6dd42a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f88910af193d37e5cd3a49914d6dd42a.jpg saved to cache
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9877d0>
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_d0cfe397f969a59ed059911e163c6547.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_d0cfe397f969a59ed059911e163c6547.jpg saved to cache
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_ca9b1afa4d6ae892325419ecb80b001d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2439bd5064dcba3e5aa7b4df2c1e2df5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_209cd8513632e5c8de6d4e361eaa89c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_209cd8513632e5c8de6d4e361eaa89c9.jpg not downloaded yet
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_b678eba92cf1bf3818a9d77109932893.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_b678eba92cf1bf3818a9d77109932893.jpg not downloaded yet
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbc4a90>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_e63108e4ef3096badba14277420562e1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_e63108e4ef3096badba14277420562e1.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9cc4ad0>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_21f1f8e9a009a6afb33f0185a2f1e347.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_21f1f8e9a009a6afb33f0185a2f1e347.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba8bd10>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_ad791a8733c0a9c238a02d5fc1d0707a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_ad791a8733c0a9c238a02d5fc1d0707a.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994
2026-03-28 12:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f with scrape type 1
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_7a63d3bd79293a9abfe9935d1bfa406f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_7a63d3bd79293a9abfe9935d1bfa406f.jpg not downloaded yet
2026-03-28 12:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525
2026-03-28 12:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with scrape type 1
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_c522390237ad2b516881fcebdf7cf43b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_c522390237ad2b516881fcebdf7cf43b.jpg not downloaded yet
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_a5871fdbb36ba2ead5f40fd4062c9945.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_a5871fdbb36ba2ead5f40fd4062c9945.jpg not downloaded yet
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_df122fa04fad244c755b2bef5ca90512.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_54bda4d3b2882a86186ccc162e936f8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_79baba75b917d67bbd4c64bfd8950a54.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_79baba75b917d67bbd4c64bfd8950a54.jpg not downloaded yet
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_e65879be4e68e695f29c2286ad7cab71.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_e65879be4e68e695f29c2286ad7cab71.jpg not downloaded yet
2026-03-28 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_c59902f36ee1e711a84f96407e82a5c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_510c21e8f206c31570399119d0de4625.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_510c21e8f206c31570399119d0de4625.jpg not downloaded yet
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_732a6337225a9e082e82a31222c47466.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_732a6337225a9e082e82a31222c47466.jpg not downloaded yet
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caeb7f10>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_ca9b1afa4d6ae892325419ecb80b001d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_ca9b1afa4d6ae892325419ecb80b001d.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8aa490>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_2439bd5064dcba3e5aa7b4df2c1e2df5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2439bd5064dcba3e5aa7b4df2c1e2df5.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_6527b8a6d12f4b4edf6d37ee610cde75.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_6527b8a6d12f4b4edf6d37ee610cde75.jpg not downloaded yet
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_bc08d8d3c0dc6c617b355bad64c783f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_bc08d8d3c0dc6c617b355bad64c783f0.jpg not downloaded yet
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_9828bd9680f008515a7a01c794137ef1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_5e2c694fb9007b5a81e4f47d69d287be.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_493b237f8570e7269965d7bed800146a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_b8b40f2ebace661f25862cf5fc92e118.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f326aa232e9222c109866e71b8e83867.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_dd6e8292c45008f46d615c77d23f9bb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_dd6e8292c45008f46d615c77d23f9bb2.jpg not downloaded yet
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_03b2c14484c5c5ee2d1013c412075256.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_03b2c14484c5c5ee2d1013c412075256.jpg not downloaded yet
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbafb250>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_df122fa04fad244c755b2bef5ca90512.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_df122fa04fad244c755b2bef5ca90512.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba9c5d0>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_54bda4d3b2882a86186ccc162e936f8c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_54bda4d3b2882a86186ccc162e936f8c.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb82b290>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_c59902f36ee1e711a84f96407e82a5c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_c59902f36ee1e711a84f96407e82a5c6.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_210c4aa95f6709b046ca30a3f06b5a71.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_210c4aa95f6709b046ca30a3f06b5a71.jpg not downloaded yet
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_6cfa6f5547d28db5c64bf9edcfaeabfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_6cfa6f5547d28db5c64bf9edcfaeabfd.jpg not downloaded yet
2026-03-28 12:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba688d0>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_9828bd9680f008515a7a01c794137ef1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_9828bd9680f008515a7a01c794137ef1.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cabf9990>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_5e2c694fb9007b5a81e4f47d69d287be.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_5e2c694fb9007b5a81e4f47d69d287be.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae1e910>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_493b237f8570e7269965d7bed800146a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_493b237f8570e7269965d7bed800146a.jpg saved to cache
2026-03-28 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caea0890>
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_b8b40f2ebace661f25862cf5fc92e118.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_b8b40f2ebace661f25862cf5fc92e118.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb834690>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_f326aa232e9222c109866e71b8e83867.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f326aa232e9222c109866e71b8e83867.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_abd00a7056356bec471e6d3af9885330.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_abd00a7056356bec471e6d3af9885330.jpg not downloaded yet
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_a5871fdbb36ba2ead5f40fd4062c9945.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_bc08d8d3c0dc6c617b355bad64c783f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2f4b7585ee6487653677616231dea7fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_1e04f5b3860b26a9aa50ea29bab7be98.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_67b149c1f569725271a04f556e4febd9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_03ac0cbc36edbc455e73091ef4fca055.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_7ccb4cfe1bc46bca9fd5208924958cf2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_3b56e3d20ba83508c8bc9f4aea37d8c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_e65879be4e68e695f29c2286ad7cab71.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_abd00a7056356bec471e6d3af9885330.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_6cfa6f5547d28db5c64bf9edcfaeabfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_dd6e8292c45008f46d615c77d23f9bb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_79baba75b917d67bbd4c64bfd8950a54.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_03b2c14484c5c5ee2d1013c412075256.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8f5910>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_a5871fdbb36ba2ead5f40fd4062c9945.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_a5871fdbb36ba2ead5f40fd4062c9945.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad822d0>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_bc08d8d3c0dc6c617b355bad64c783f0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_bc08d8d3c0dc6c617b355bad64c783f0.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_210c4aa95f6709b046ca30a3f06b5a71.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_6527b8a6d12f4b4edf6d37ee610cde75.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_732a6337225a9e082e82a31222c47466.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbbe6150>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_2f4b7585ee6487653677616231dea7fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2f4b7585ee6487653677616231dea7fc.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8b5550>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fc0%252F5ec07643273114ada10da69bd05b1264%252Fpa%252FZS54708_1e04f5b3860b26a9aa50ea29bab7be98.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_1e04f5b3860b26a9aa50ea29bab7be98.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f
2026-03-28 12:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f, skipping ID generation
2026-03-28 12:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with scrape type 1
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f sending to next pipeline
2026-03-28 12:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f, identifier: ZS54708
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac54cd0>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_67b149c1f569725271a04f556e4febd9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_67b149c1f569725271a04f556e4febd9.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caed8650>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_03ac0cbc36edbc455e73091ef4fca055.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_03ac0cbc36edbc455e73091ef4fca055.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8aa590>
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F58%252Fef58dd5f7127ecb590a0716dc1bef326%252Fpa%252FEG04578_7ccb4cfe1bc46bca9fd5208924958cf2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_7ccb4cfe1bc46bca9fd5208924958cf2.jpg saved to cache
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e138907-1898-58c8-850b-a799c8ed88b0
2026-03-28 12:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e138907-1898-58c8-850b-a799c8ed88b0, skipping ID generation
2026-03-28 12:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e138907-1898-58c8-850b-a799c8ed88b0 with scrape type 1
2026-03-28 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e138907-1898-58c8-850b-a799c8ed88b0 sending to next pipeline
2026-03-28 12:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e138907-1898-58c8-850b-a799c8ed88b0, identifier: EG04578
2026-03-28 12:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caff4790>
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_3b56e3d20ba83508c8bc9f4aea37d8c0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_3b56e3d20ba83508c8bc9f4aea37d8c0.jpg saved to cache
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cace3950>
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_e65879be4e68e695f29c2286ad7cab71.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_e65879be4e68e695f29c2286ad7cab71.jpg saved to cache
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafa3c10>
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_abd00a7056356bec471e6d3af9885330.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_abd00a7056356bec471e6d3af9885330.jpg saved to cache
2026-03-28 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708
2026-03-28 12:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708
2026-03-28 12:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708 to the API
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_1e04f5b3860b26a9aa50ea29bab7be98.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:46Z',
 'fuel_type': 'petrol',
 'id': '7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS54708',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 167235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_d0cfe397f969a59ed059911e163c6547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280624,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_ca9b1afa4d6ae892325419ecb80b001d.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_21f1f8e9a009a6afb33f0185a2f1e347.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313910,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_1e04f5b3860b26a9aa50ea29bab7be98.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_c59902f36ee1e711a84f96407e82a5c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406442,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_9828bd9680f008515a7a01c794137ef1.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f/7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/c0/5ec07643273114ada10da69bd05b1264/pa/ZS54708_b8b40f2ebace661f25862cf5fc92e118.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-28 12:01:37 [auto1.nl] INFO: Saving data for ZS54708: {'created_time': 1774699297.64572, 'last_price_update_time': 1774699297.645729, 'auction_closing_time': 1774885846.0}
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZS54708') HTTP/1.1" 204 0
2026-03-28 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578
2026-03-28 12:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578
2026-03-28 12:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578 to the API
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_7ccb4cfe1bc46bca9fd5208924958cf2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 238,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 173,
 'expiration_date': '2026-03-30T15:08:17Z',
 'fuel_type': 'diesel',
 'id': '7e138907-1898-58c8-850b-a799c8ed88b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '43XHVk',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG04578',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 158628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015522,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_7ccb4cfe1bc46bca9fd5208924958cf2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_3c8da44a34c1fb22b45bd14fed9f0daf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_5ce7e9d593bbad69430e86c2947fd8fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3150184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_4658a4c5c59f1b3aa91b37b3c1347f3b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_761ba7743f1800bf87fbf85e64722178.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_ce24686e78617db51091170f7fd7e434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_dd56ae221a0475c1346f4a2df9864c12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_111f02ec411144635c1efcd3e0957fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_37148a45477ad36fc5e925e725757805.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e138907-1898-58c8-850b-a799c8ed88b0/7e138907-1898-58c8-850b-a799c8ed88b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/58/ef58dd5f7127ecb590a0716dc1bef326/pa/EG04578_8dce7e03228eb1ab85394f3bf2770da9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Saving data for EG04578: {'created_time': 1774699298.093054, 'last_price_update_time': 1774699298.093064, 'auction_closing_time': 1774883297.0}
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG04578') HTTP/1.1" 204 0
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_510c21e8f206c31570399119d0de4625.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cace3f50>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_6cfa6f5547d28db5c64bf9edcfaeabfd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_6cfa6f5547d28db5c64bf9edcfaeabfd.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cafb67d0>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_dd6e8292c45008f46d615c77d23f9bb2.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_dd6e8292c45008f46d615c77d23f9bb2.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbb91510>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_79baba75b917d67bbd4c64bfd8950a54.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_79baba75b917d67bbd4c64bfd8950a54.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN27243> (referer: https://www.auto1.com/v1/car-details-view/GN27243/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA80107> (referer: https://www.auto1.com/v1/car-details-view/UA80107/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba39cd0>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_03b2c14484c5c5ee2d1013c412075256.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_03b2c14484c5c5ee2d1013c412075256.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caec7c50>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_210c4aa95f6709b046ca30a3f06b5a71.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_210c4aa95f6709b046ca30a3f06b5a71.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d88c4f10>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_6527b8a6d12f4b4edf6d37ee610cde75.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_6527b8a6d12f4b4edf6d37ee610cde75.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba9e9d0>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_732a6337225a9e082e82a31222c47466.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_732a6337225a9e082e82a31222c47466.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d88c6210>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_510c21e8f206c31570399119d0de4625.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_510c21e8f206c31570399119d0de4625.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_7a63d3bd79293a9abfe9935d1bfa406f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_c522390237ad2b516881fcebdf7cf43b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243
2026-03-28 12:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ebb51e1-b300-5445-82c2-a5d3f157c222 with scrape type 1
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_0016df8ce8989e805f33db7fc3aa59f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0016df8ce8989e805f33db7fc3aa59f7.jpg not downloaded yet
2026-03-28 12:01:38 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107
2026-03-28 12:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2544507b-6f15-57b8-afb9-35cb3bd731b5 with scrape type 1
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_58bcb2fca8f5521d082383317cc50a3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_58bcb2fca8f5521d082383317cc50a3c.jpg not downloaded yet
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_e376a9498c29bfda6589713607ba324c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e376a9498c29bfda6589713607ba324c.jpg not downloaded yet
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62268%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for HX62268: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for BE76328: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for TG03602: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH10928%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for PH10928: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP13228%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for CP13228: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH25512%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for HH25512: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for LH67432: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW17403%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for TW17403: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG23592%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for WG23592: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY25778%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for SY25778: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-28 12:01:38 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_e9abb61fa3678010f4a0fba3147b2e2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_e9abb61fa3678010f4a0fba3147b2e2a.jpg not downloaded yet
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_728d58a143c590f976d8b1b4ccf57cbe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_209cd8513632e5c8de6d4e361eaa89c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_0a6c65d0a4d3c76bc28620b30c04e97d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0a6c65d0a4d3c76bc28620b30c04e97d.jpg not downloaded yet
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_c88c12863b4ea08898925f039ac7dc97.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c88c12863b4ea08898925f039ac7dc97.jpg not downloaded yet
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba89950>
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48569fc671efefacce0e4ec5eaebbe20%252Fpa%252FUU92994_7a63d3bd79293a9abfe9935d1bfa406f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_7a63d3bd79293a9abfe9935d1bfa406f.jpg saved to cache
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f
2026-03-28 12:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca1b2cc0-ad5b-5931-a174-f938dd042c6f, skipping ID generation
2026-03-28 12:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f with scrape type 1
2026-03-28 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f sending to next pipeline
2026-03-28 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca1b2cc0-ad5b-5931-a174-f938dd042c6f, identifier: UU92994
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae666d0>
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F19%252F6319feebd3df974e8d1aa3ca0669251d%252Fpa%252FKX92525_c522390237ad2b516881fcebdf7cf43b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_c522390237ad2b516881fcebdf7cf43b.jpg saved to cache
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3
2026-03-28 12:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d58f8112-962c-547b-8d9b-c2cd8e90d9e3, skipping ID generation
2026-03-28 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with scrape type 1
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3 sending to next pipeline
2026-03-28 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d58f8112-962c-547b-8d9b-c2cd8e90d9e3, identifier: KX92525
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_9ce49610dff7204469f6e7557963fa25.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_9ce49610dff7204469f6e7557963fa25.jpg not downloaded yet
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_83a0a70354d963f34d6858dd9cb46c31.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_83a0a70354d963f34d6858dd9cb46c31.jpg not downloaded yet
2026-03-28 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994
2026-03-28 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994
2026-03-28 12:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994 to the API
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_7a63d3bd79293a9abfe9935d1bfa406f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:16:03Z',
 'fuel_type': 'petrol',
 'id': 'ca1b2cc0-ad5b-5931-a174-f938dd042c6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU92994',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 231486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_7a63d3bd79293a9abfe9935d1bfa406f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225851,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_79baba75b917d67bbd4c64bfd8950a54.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_510c21e8f206c31570399119d0de4625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_6527b8a6d12f4b4edf6d37ee610cde75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212820,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_dd6e8292c45008f46d615c77d23f9bb2.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279824,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_210c4aa95f6709b046ca30a3f06b5a71.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1b2cc0-ad5b-5931-a174-f938dd042c6f/ca1b2cc0-ad5b-5931-a174-f938dd042c6f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229945,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img48/56/48569fc671efefacce0e4ec5eaebbe20/pa/UU92994_abd00a7056356bec471e6d3af9885330.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Kombi BlueMotion',
 'transmission': 'manual',
 'trim': 'Kombi BlueMotion',
 'year': 2020}
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-28 12:01:39 [auto1.nl] INFO: Saving data for UU92994: {'created_time': 1774699299.758286, 'last_price_update_time': 1774699299.758295, 'auction_closing_time': 1774883763.0}
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UU92994') HTTP/1.1" 204 0
2026-03-28 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525
2026-03-28 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525
2026-03-28 12:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525 to the API
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_c522390237ad2b516881fcebdf7cf43b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'diesel',
 'id': 'd58f8112-962c-547b-8d9b-c2cd8e90d9e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX92525',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 228744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_c522390237ad2b516881fcebdf7cf43b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_e65879be4e68e695f29c2286ad7cab71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_732a6337225a9e082e82a31222c47466.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_bc08d8d3c0dc6c617b355bad64c783f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_03b2c14484c5c5ee2d1013c412075256.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58f8112-962c-547b-8d9b-c2cd8e90d9e3/d58f8112-962c-547b-8d9b-c2cd8e90d9e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/19/6319feebd3df974e8d1aa3ca0669251d/pa/KX92525_6cfa6f5547d28db5c64bf9edcfaeabfd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI Kompakt',
 'transmission': 'automatic',
 'trim': 'Kompakt',
 'year': 2019}
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [auto1.nl] INFO: Saving data for KX92525: {'created_time': 1774699300.307302, 'last_price_update_time': 1774699300.307313, 'auction_closing_time': 1774885637.0}
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX92525') HTTP/1.1" 204 0
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_58bcb2fca8f5521d082383317cc50a3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0016df8ce8989e805f33db7fc3aa59f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e376a9498c29bfda6589713607ba324c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_e9abb61fa3678010f4a0fba3147b2e2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_3883e342f2116c89e2bc59937b8ff44c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_3883e342f2116c89e2bc59937b8ff44c.jpg not downloaded yet
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_344edf14ba650abde138ca4764cfcdb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_344edf14ba650abde138ca4764cfcdb1.jpg not downloaded yet
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY08351> (referer: https://www.auto1.com/v1/car-details-view/VY08351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH76205> (referer: https://www.auto1.com/v1/car-details-view/UH76205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb990210>
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F8c%252Fb68c612d3a838d9b31914b6fdcb7ff2e%252Fpa%252FWY17438_728d58a143c590f976d8b1b4ccf57cbe.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_728d58a143c590f976d8b1b4ccf57cbe.jpg saved to cache
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20c2a98f-817f-50d9-9776-aee4fe773a4f
2026-03-28 12:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20c2a98f-817f-50d9-9776-aee4fe773a4f, skipping ID generation
2026-03-28 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c2a98f-817f-50d9-9776-aee4fe773a4f with scrape type 1
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20c2a98f-817f-50d9-9776-aee4fe773a4f sending to next pipeline
2026-03-28 12:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20c2a98f-817f-50d9-9776-aee4fe773a4f, identifier: WY17438
2026-03-28 12:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9cc33d0>
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_209cd8513632e5c8de6d4e361eaa89c9.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_209cd8513632e5c8de6d4e361eaa89c9.jpg saved to cache
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_1fcab1a17fc30165ae7a02b354c25ba1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_1fcab1a17fc30165ae7a02b354c25ba1.jpg not downloaded yet
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_5f7903ce242302c2c2e6aa4178013b20.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_5f7903ce242302c2c2e6aa4178013b20.jpg not downloaded yet
2026-03-28 12:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438
2026-03-28 12:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438
2026-03-28 12:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438 to the API
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_728d58a143c590f976d8b1b4ccf57cbe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:39:28Z',
 'fuel_type': 'electro',
 'id': '20c2a98f-817f-50d9-9776-aee4fe773a4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY17438',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 104972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f88910af193d37e5cd3a49914d6dd42a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292663,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2439bd5064dcba3e5aa7b4df2c1e2df5.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290960,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_728d58a143c590f976d8b1b4ccf57cbe.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_2f4b7585ee6487653677616231dea7fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381795,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_67b149c1f569725271a04f556e4febd9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399635,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_5e2c694fb9007b5a81e4f47d69d287be.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20c2a98f-817f-50d9-9776-aee4fe773a4f/20c2a98f-817f-50d9-9776-aee4fe773a4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/8c/b68c612d3a838d9b31914b6fdcb7ff2e/pa/WY17438_f326aa232e9222c109866e71b8e83867.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2019}
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [auto1.nl] INFO: Saving data for WY17438: {'created_time': 1774699301.03583, 'last_price_update_time': 1774699301.035841, 'auction_closing_time': 1774885168.0}
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY17438') HTTP/1.1" 204 0
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0a6c65d0a4d3c76bc28620b30c04e97d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_9ce49610dff7204469f6e7557963fa25.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_c9a0618f5fa330b06d70858d26b4c452.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_c9a0618f5fa330b06d70858d26b4c452.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_c47e86472393575ff3f8549d1e69a9ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c47e86472393575ff3f8549d1e69a9ed.jpg not downloaded yet
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb991110>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_58bcb2fca8f5521d082383317cc50a3c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_58bcb2fca8f5521d082383317cc50a3c.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac56a50>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_0016df8ce8989e805f33db7fc3aa59f7.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0016df8ce8989e805f33db7fc3aa59f7.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caca7c90>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_e376a9498c29bfda6589713607ba324c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e376a9498c29bfda6589713607ba324c.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caff5150>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_e9abb61fa3678010f4a0fba3147b2e2a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_e9abb61fa3678010f4a0fba3147b2e2a.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351
2026-03-28 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26058572-de28-5718-8611-83e2ce98a669 with scrape type 1
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_4f31a74160fc185719d0c9aa43fc434e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_4f31a74160fc185719d0c9aa43fc434e.jpg not downloaded yet
2026-03-28 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205
2026-03-28 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce34d86-5647-500b-9ed1-d7d90d905e87 with scrape type 1
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_5c596cff3e2e68ddb3a24ef15c525aa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_5c596cff3e2e68ddb3a24ef15c525aa1.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c88c12863b4ea08898925f039ac7dc97.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_458f4558b82f8e2399c5213c2730a5f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_458f4558b82f8e2399c5213c2730a5f0.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_83a0a70354d963f34d6858dd9cb46c31.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_3883e342f2116c89e2bc59937b8ff44c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_ab83ef58bc398fd6cf6da40cd4c2b8b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ab83ef58bc398fd6cf6da40cd4c2b8b5.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_81c503db233190b393b57237c67a359e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_81c503db233190b393b57237c67a359e.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_344edf14ba650abde138ca4764cfcdb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_27ca169d23be5a619b8a02abab51957c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_27ca169d23be5a619b8a02abab51957c.jpg not downloaded yet
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbabef90>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_0a6c65d0a4d3c76bc28620b30c04e97d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0a6c65d0a4d3c76bc28620b30c04e97d.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacb6ad0>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_9ce49610dff7204469f6e7557963fa25.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_9ce49610dff7204469f6e7557963fa25.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_dfa89dd1161ea15b730bca3bb5c9b41a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_dfa89dd1161ea15b730bca3bb5c9b41a.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_39d73cbdebb922f6bec7a16ca59fa64b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_39d73cbdebb922f6bec7a16ca59fa64b.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_1fcab1a17fc30165ae7a02b354c25ba1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_e433d291ab8269562e419db210ae887f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e433d291ab8269562e419db210ae887f.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_5f7903ce242302c2c2e6aa4178013b20.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_4f31a74160fc185719d0c9aa43fc434e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_5c596cff3e2e68ddb3a24ef15c525aa1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_ac1840eda8a3baf85319ad8112b17001.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ac1840eda8a3baf85319ad8112b17001.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_0ec5a8a9898a57b5b90b1192952cc388.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_0ec5a8a9898a57b5b90b1192952cc388.jpg not downloaded yet
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae84250>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_c88c12863b4ea08898925f039ac7dc97.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c88c12863b4ea08898925f039ac7dc97.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb835110>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_83a0a70354d963f34d6858dd9cb46c31.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_83a0a70354d963f34d6858dd9cb46c31.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae3e350>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_3883e342f2116c89e2bc59937b8ff44c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_3883e342f2116c89e2bc59937b8ff44c.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_c9a0618f5fa330b06d70858d26b4c452.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_458f4558b82f8e2399c5213c2730a5f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_f835f59adc0ca9de883e6648365b03fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_f835f59adc0ca9de883e6648365b03fc.jpg not downloaded yet
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_63642e0e4b9708953a05b0805f578ff1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_63642e0e4b9708953a05b0805f578ff1.jpg not downloaded yet
2026-03-28 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c47e86472393575ff3f8549d1e69a9ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8f6ed0>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_344edf14ba650abde138ca4764cfcdb1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_344edf14ba650abde138ca4764cfcdb1.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8f4090>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_1fcab1a17fc30165ae7a02b354c25ba1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_1fcab1a17fc30165ae7a02b354c25ba1.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb9cb410>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_5f7903ce242302c2c2e6aa4178013b20.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_5f7903ce242302c2c2e6aa4178013b20.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae02350>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_4f31a74160fc185719d0c9aa43fc434e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_4f31a74160fc185719d0c9aa43fc434e.jpg saved to cache
2026-03-28 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacb3590>
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_5c596cff3e2e68ddb3a24ef15c525aa1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_5c596cff3e2e68ddb3a24ef15c525aa1.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_dfa89dd1161ea15b730bca3bb5c9b41a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_c63fd92099dca01797c609166815e5dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_c63fd92099dca01797c609166815e5dd.jpg not downloaded yet
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_1241a49b2d0a8e4fe55f2ea158beec24.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_1241a49b2d0a8e4fe55f2ea158beec24.jpg not downloaded yet
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ab83ef58bc398fd6cf6da40cd4c2b8b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_13d36dbb9acf7469ad231fc92afb447d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_13d36dbb9acf7469ad231fc92afb447d.jpg not downloaded yet
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_bf58da89ab385418b2bba963b3501a3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_bf58da89ab385418b2bba963b3501a3c.jpg not downloaded yet
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb862f50>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_c9a0618f5fa330b06d70858d26b4c452.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_c9a0618f5fa330b06d70858d26b4c452.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad95b10>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_458f4558b82f8e2399c5213c2730a5f0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_458f4558b82f8e2399c5213c2730a5f0.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac9c590>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2d%252Fcc2d46cf818abf8daf387dab49f1312a%252Fpa%252FUA80107_c47e86472393575ff3f8549d1e69a9ed.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c47e86472393575ff3f8549d1e69a9ed.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2544507b-6f15-57b8-afb9-35cb3bd731b5
2026-03-28 12:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2544507b-6f15-57b8-afb9-35cb3bd731b5, skipping ID generation
2026-03-28 12:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2544507b-6f15-57b8-afb9-35cb3bd731b5 with scrape type 1
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2544507b-6f15-57b8-afb9-35cb3bd731b5 sending to next pipeline
2026-03-28 12:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2544507b-6f15-57b8-afb9-35cb3bd731b5, identifier: UA80107
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_39d73cbdebb922f6bec7a16ca59fa64b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_81c503db233190b393b57237c67a359e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107
2026-03-28 12:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107
2026-03-28 12:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107 to the API
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c47e86472393575ff3f8549d1e69a9ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'diesel',
 'id': '2544507b-6f15-57b8-afb9-35cb3bd731b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA80107',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 361014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_58bcb2fca8f5521d082383317cc50a3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_e9abb61fa3678010f4a0fba3147b2e2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208043,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c88c12863b4ea08898925f039ac7dc97.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228387,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_83a0a70354d963f34d6858dd9cb46c31.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_344edf14ba650abde138ca4764cfcdb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_5f7903ce242302c2c2e6aa4178013b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544507b-6f15-57b8-afb9-35cb3bd731b5/2544507b-6f15-57b8-afb9-35cb3bd731b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/2d/cc2d46cf818abf8daf387dab49f1312a/pa/UA80107_c47e86472393575ff3f8549d1e69a9ed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 290 L2',
 'transmission': 'manual',
 'trim': '290 L2',
 'year': 2021}
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-28 12:01:42 [auto1.nl] INFO: Saving data for UA80107: {'created_time': 1774699302.796768, 'last_price_update_time': 1774699302.796778, 'auction_closing_time': 1774884887.0}
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UA80107') HTTP/1.1" 204 0
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ac1840eda8a3baf85319ad8112b17001.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_27ca169d23be5a619b8a02abab51957c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e433d291ab8269562e419db210ae887f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_0ec5a8a9898a57b5b90b1192952cc388.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_63642e0e4b9708953a05b0805f578ff1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9a0a510>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_dfa89dd1161ea15b730bca3bb5c9b41a.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_dfa89dd1161ea15b730bca3bb5c9b41a.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9cc4c50>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_ab83ef58bc398fd6cf6da40cd4c2b8b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ab83ef58bc398fd6cf6da40cd4c2b8b5.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:42 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cac153d0>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_39d73cbdebb922f6bec7a16ca59fa64b.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_39d73cbdebb922f6bec7a16ca59fa64b.jpg saved to cache
2026-03-28 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb911350>
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_81c503db233190b393b57237c67a359e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_81c503db233190b393b57237c67a359e.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_f835f59adc0ca9de883e6648365b03fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_13d36dbb9acf7469ad231fc92afb447d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC90690%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for VC90690: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT16898%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for TT16898: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT83574%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for KT83574: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for RX96199: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VG54194%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for VG54194: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV23834%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for TV23834: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX49205%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for EX49205: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for YT16121: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN01630%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for AN01630: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH82816%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for EH82816: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ17437%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for UJ17437: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU28768%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for PU28768: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-28 12:01:43 [auto1.nl] INFO: Scrape type for RC67109: 0
2026-03-28 12:01:43 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_c63fd92099dca01797c609166815e5dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb834750>
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_ac1840eda8a3baf85319ad8112b17001.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ac1840eda8a3baf85319ad8112b17001.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cba1efd0>
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_27ca169d23be5a619b8a02abab51957c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_27ca169d23be5a619b8a02abab51957c.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cbabbed0>
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff3%252F3af347a73aef4e82b371a30cd8568fc7%252Fpa%252FGN27243_e433d291ab8269562e419db210ae887f.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e433d291ab8269562e419db210ae887f.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ebb51e1-b300-5445-82c2-a5d3f157c222
2026-03-28 12:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ebb51e1-b300-5445-82c2-a5d3f157c222, skipping ID generation
2026-03-28 12:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ebb51e1-b300-5445-82c2-a5d3f157c222 with scrape type 1
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ebb51e1-b300-5445-82c2-a5d3f157c222 sending to next pipeline
2026-03-28 12:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ebb51e1-b300-5445-82c2-a5d3f157c222, identifier: GN27243
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2da806690>
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_0ec5a8a9898a57b5b90b1192952cc388.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_0ec5a8a9898a57b5b90b1192952cc388.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf17710>
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_63642e0e4b9708953a05b0805f578ff1.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_63642e0e4b9708953a05b0805f578ff1.jpg saved to cache
2026-03-28 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_b678eba92cf1bf3818a9d77109932893.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243
2026-03-28 12:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243
2026-03-28 12:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243 to the API
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e433d291ab8269562e419db210ae887f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:22:19Z',
 'fuel_type': 'petrol',
 'id': '7ebb51e1-b300-5445-82c2-a5d3f157c222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RS151J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN27243',
 'listing': 'auction',
 'location': 'NL, Maastricht',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 108608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0016df8ce8989e805f33db7fc3aa59f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e376a9498c29bfda6589713607ba324c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_0a6c65d0a4d3c76bc28620b30c04e97d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_9ce49610dff7204469f6e7557963fa25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_3883e342f2116c89e2bc59937b8ff44c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_1fcab1a17fc30165ae7a02b354c25ba1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_c9a0618f5fa330b06d70858d26b4c452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_458f4558b82f8e2399c5213c2730a5f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_27ca169d23be5a619b8a02abab51957c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebb51e1-b300-5445-82c2-a5d3f157c222/7ebb51e1-b300-5445-82c2-a5d3f157c222_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f3/3af347a73aef4e82b371a30cd8568fc7/pa/GN27243_e433d291ab8269562e419db210ae887f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.nl] INFO: Saving data for GN27243: {'created_time': 1774699304.055155, 'last_price_update_time': 1774699304.055163, 'auction_closing_time': 1774884139.0}
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN27243') HTTP/1.1" 204 0
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_bf58da89ab385418b2bba963b3501a3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_1241a49b2d0a8e4fe55f2ea158beec24.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae35210>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_f835f59adc0ca9de883e6648365b03fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_f835f59adc0ca9de883e6648365b03fc.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb829150>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_13d36dbb9acf7469ad231fc92afb447d.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_13d36dbb9acf7469ad231fc92afb447d.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caff7750>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F50%252F4d5077c1eb5ee21bb03fcbb049a7074b%252Fpa%252FVY08351_c63fd92099dca01797c609166815e5dd.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_c63fd92099dca01797c609166815e5dd.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26058572-de28-5718-8611-83e2ce98a669
2026-03-28 12:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26058572-de28-5718-8611-83e2ce98a669, skipping ID generation
2026-03-28 12:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26058572-de28-5718-8611-83e2ce98a669 with scrape type 1
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26058572-de28-5718-8611-83e2ce98a669 sending to next pipeline
2026-03-28 12:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 26058572-de28-5718-8611-83e2ce98a669, identifier: VY08351
2026-03-28 12:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351
2026-03-28 12:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351
2026-03-28 12:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351 to the API
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_c63fd92099dca01797c609166815e5dd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:04Z',
 'fuel_type': 'diesel',
 'id': '26058572-de28-5718-8611-83e2ce98a669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY08351',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 239020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_4f31a74160fc185719d0c9aa43fc434e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ab83ef58bc398fd6cf6da40cd4c2b8b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_dfa89dd1161ea15b730bca3bb5c9b41a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_ac1840eda8a3baf85319ad8112b17001.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_f835f59adc0ca9de883e6648365b03fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_c63fd92099dca01797c609166815e5dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26058572-de28-5718-8611-83e2ce98a669/26058572-de28-5718-8611-83e2ce98a669_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/50/4d5077c1eb5ee21bb03fcbb049a7074b/pa/VY08351_13d36dbb9acf7469ad231fc92afb447d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2020}
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-28 12:01:44 [auto1.nl] INFO: Saving data for VY08351: {'created_time': 1774699304.771174, 'last_price_update_time': 1774699304.771373, 'auction_closing_time': 1774883584.0}
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VY08351') HTTP/1.1" 204 0
2026-03-28 12:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb8a8210>
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb4%252Fc5b44de70b7d95e51ad4c3e06f06c5b7%252Fpa%252FBB32456_b678eba92cf1bf3818a9d77109932893.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_b678eba92cf1bf3818a9d77109932893.jpg saved to cache
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 977d1786-000a-57ea-a389-213e0bc4dc9f
2026-03-28 12:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 977d1786-000a-57ea-a389-213e0bc4dc9f, skipping ID generation
2026-03-28 12:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977d1786-000a-57ea-a389-213e0bc4dc9f with scrape type 1
2026-03-28 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 977d1786-000a-57ea-a389-213e0bc4dc9f sending to next pipeline
2026-03-28 12:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 977d1786-000a-57ea-a389-213e0bc4dc9f, identifier: BB32456
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP39959> (referer: https://www.auto1.com/v1/car-details-view/MP39959/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456
2026-03-28 12:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456
2026-03-28 12:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456 to the API
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_b678eba92cf1bf3818a9d77109932893.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:00:50Z',
 'fuel_type': 'petrol',
 'id': '977d1786-000a-57ea-a389-213e0bc4dc9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K273NP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB32456',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 212777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_03ac0cbc36edbc455e73091ef4fca055.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_3b56e3d20ba83508c8bc9f4aea37d8c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48242,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_e63108e4ef3096badba14277420562e1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46614,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_ad791a8733c0a9c238a02d5fc1d0707a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49713,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_df122fa04fad244c755b2bef5ca90512.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44290,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_54bda4d3b2882a86186ccc162e936f8c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38286,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_493b237f8570e7269965d7bed800146a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275124,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_209cd8513632e5c8de6d4e361eaa89c9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2336134,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_b678eba92cf1bf3818a9d77109932893.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977d1786-000a-57ea-a389-213e0bc4dc9f/977d1786-000a-57ea-a389-213e0bc4dc9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41701,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/b4/c5b44de70b7d95e51ad4c3e06f06c5b7/pa/BB32456_a5871fdbb36ba2ead5f40fd4062c9945.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-28 12:01:45 [auto1.nl] INFO: Saving data for BB32456: {'created_time': 1774699305.376124, 'last_price_update_time': 1774699305.376139, 'auction_closing_time': 1774882850.0}
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BB32456') HTTP/1.1" 204 0
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caca72d0>
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_bf58da89ab385418b2bba963b3501a3c.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_bf58da89ab385418b2bba963b3501a3c.jpg saved to cache
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf8d3d0>
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fe4%252F86e49ab0f967c246f5750a09d1cf8eb7%252Fpa%252FUH76205_1241a49b2d0a8e4fe55f2ea158beec24.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_1241a49b2d0a8e4fe55f2ea158beec24.jpg saved to cache
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ce34d86-5647-500b-9ed1-d7d90d905e87
2026-03-28 12:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ce34d86-5647-500b-9ed1-d7d90d905e87, skipping ID generation
2026-03-28 12:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce34d86-5647-500b-9ed1-d7d90d905e87 with scrape type 1
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ce34d86-5647-500b-9ed1-d7d90d905e87 sending to next pipeline
2026-03-28 12:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ce34d86-5647-500b-9ed1-d7d90d905e87, identifier: UH76205
2026-03-28 12:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205
2026-03-28 12:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205
2026-03-28 12:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205 to the API
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_1241a49b2d0a8e4fe55f2ea158beec24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:06:23Z',
 'fuel_type': 'diesel',
 'id': '7ce34d86-5647-500b-9ed1-d7d90d905e87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH76205',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 231745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_5c596cff3e2e68ddb3a24ef15c525aa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196914,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_81c503db233190b393b57237c67a359e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203270,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_39d73cbdebb922f6bec7a16ca59fa64b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_0ec5a8a9898a57b5b90b1192952cc388.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_63642e0e4b9708953a05b0805f578ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215898,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_1241a49b2d0a8e4fe55f2ea158beec24.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce34d86-5647-500b-9ed1-d7d90d905e87/7ce34d86-5647-500b-9ed1-d7d90d905e87_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249880,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img86/e4/86e49ab0f967c246f5750a09d1cf8eb7/pa/UH76205_bf58da89ab385418b2bba963b3501a3c.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L2H1 2,9t Komfort',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Komfort',
 'year': 2018}
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-28 12:01:45 [auto1.nl] INFO: Saving data for UH76205: {'created_time': 1774699305.928081, 'last_price_update_time': 1774699305.928095, 'auction_closing_time': 1774883183.0}
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UH76205') HTTP/1.1" 204 0
2026-03-28 12:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959
2026-03-28 12:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e44968-0238-5bb8-a93d-151689ed6907 with scrape type 1
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 97e44968-0238-5bb8-a93d-151689ed6907
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_257a7b852736694a27e84bab919143df.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_257a7b852736694a27e84bab919143df.jpg not downloaded yet
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_f466ebdd56c8c2ee21287ad9601140d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_f466ebdd56c8c2ee21287ad9601140d5.jpg not downloaded yet
2026-03-28 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_9bff72610b2e693b2399f8c2ed2dcca0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_9bff72610b2e693b2399f8c2ed2dcca0.jpg not downloaded yet
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_ec837fb335e7268d7cbcb1ed9a06656e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_ec837fb335e7268d7cbcb1ed9a06656e.jpg not downloaded yet
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_d73e1f3fefa6e03e9cf558b85be3a725.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_d73e1f3fefa6e03e9cf558b85be3a725.jpg not downloaded yet
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_2ea2cc46c01de4f15b7e796cc6324418.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_2ea2cc46c01de4f15b7e796cc6324418.jpg not downloaded yet
2026-03-28 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_257a7b852736694a27e84bab919143df.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:46 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG85730%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for TG85730: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for GV74945: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for YF67230: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC11957%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for UC11957: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG43530%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for WG43530: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH74159%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for UH74159: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for DX60140: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM40908%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for GM40908: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for PW38124: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for HS40359: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for RT82599: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB77408%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for DB77408: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-28 12:01:46 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-28 12:01:46 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-28 12:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_9bff72610b2e693b2399f8c2ed2dcca0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_ec837fb335e7268d7cbcb1ed9a06656e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_2ea2cc46c01de4f15b7e796cc6324418.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_d73e1f3fefa6e03e9cf558b85be3a725.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_f466ebdd56c8c2ee21287ad9601140d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cae3fb50>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_257a7b852736694a27e84bab919143df.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_257a7b852736694a27e84bab919143df.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97e44968-0238-5bb8-a93d-151689ed6907
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2d9cbb250>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_9bff72610b2e693b2399f8c2ed2dcca0.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_9bff72610b2e693b2399f8c2ed2dcca0.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97e44968-0238-5bb8-a93d-151689ed6907
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cad824d0>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_ec837fb335e7268d7cbcb1ed9a06656e.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_ec837fb335e7268d7cbcb1ed9a06656e.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97e44968-0238-5bb8-a93d-151689ed6907
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cb98bad0>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_2ea2cc46c01de4f15b7e796cc6324418.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_2ea2cc46c01de4f15b7e796cc6324418.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97e44968-0238-5bb8-a93d-151689ed6907
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2caf14590>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_d73e1f3fefa6e03e9cf558b85be3a725.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_d73e1f3fefa6e03e9cf558b85be3a725.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97e44968-0238-5bb8-a93d-151689ed6907
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2cacc1250>
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fe8%252F34e83270c81c8cb7f23aedd5387d248a%252Fpa%252FMP39959_f466ebdd56c8c2ee21287ad9601140d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_f466ebdd56c8c2ee21287ad9601140d5.jpg saved to cache
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97e44968-0238-5bb8-a93d-151689ed6907
2026-03-28 12:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97e44968-0238-5bb8-a93d-151689ed6907, skipping ID generation
2026-03-28 12:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e44968-0238-5bb8-a93d-151689ed6907 with scrape type 1
2026-03-28 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97e44968-0238-5bb8-a93d-151689ed6907 sending to next pipeline
2026-03-28 12:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 97e44968-0238-5bb8-a93d-151689ed6907, identifier: MP39959
2026-03-28 12:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959
2026-03-28 12:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959
2026-03-28 12:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959 to the API
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_f466ebdd56c8c2ee21287ad9601140d5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:58:36Z',
 'fuel_type': 'petrol',
 'id': '97e44968-0238-5bb8-a93d-151689ed6907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '64-TPJ-7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP39959',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Nissan',
 'model': 'Pixo',
 'odometer': 170709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_257a7b852736694a27e84bab919143df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_f466ebdd56c8c2ee21287ad9601140d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_9bff72610b2e693b2399f8c2ed2dcca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_ec837fb335e7268d7cbcb1ed9a06656e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_d73e1f3fefa6e03e9cf558b85be3a725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97e44968-0238-5bb8-a93d-151689ed6907/97e44968-0238-5bb8-a93d-151689ed6907_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/e8/34e83270c81c8cb7f23aedd5387d248a/pa/MP39959_2ea2cc46c01de4f15b7e796cc6324418.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Pixo 1.0 Fun/Look',
 'transmission': 'manual',
 'trim': 'Fun/Look',
 'year': 2012}
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-28 12:01:47 [auto1.nl] INFO: Saving data for MP39959: {'created_time': 1774699307.441191, 'last_price_update_time': 1774699307.441202, 'auction_closing_time': 1774886316.0}
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP39959') HTTP/1.1" 204 0
2026-03-28 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:48 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ43979%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for JJ43979: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for DF82688: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH74130%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for LH74130: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for DM34469: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for KC58229: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for PC64486: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF74045%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for TF74045: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL71745%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for SL71745: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for ZB66825: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HU61188%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for HU61188: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV65488%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for AV65488: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC34005%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for EC34005: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for GD46513: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-28 12:01:48 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-28 12:01:48 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 12:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:49 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for PL46145: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for YD79188: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24721%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for JA24721: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for LT65669: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL58798%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for AL58798: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for RG26073: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for HV97203: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for RW09535: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN91004%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for ZN91004: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ67857%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for XZ67857: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for XJ86601: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV26065%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for TV26065: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX29422%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for AX29422: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-28 12:01:49 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-28 12:01:49 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-28 12:01:50 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK25360%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.nl] INFO: Scrape type for ZK25360: 0
2026-03-28 12:01:50 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 12:01:50 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-28 12:01:50 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-28 12:01:50 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-28 12:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:51 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.nl] INFO: Scrape type for LA08041: 0
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV84251%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.nl] INFO: Scrape type for WV84251: 0
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-28 12:01:51 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-28 12:01:51 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY73779%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for AY73779: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for TL32110: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for DS12539: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF65643%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for XF65643: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE20026%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for UE20026: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ55104%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for FZ55104: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF83736%27 HTTP/1.1" 200 None
2026-03-28 12:01:52 [auto1.nl] INFO: Scrape type for LF83736: 0
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-28 12:01:52 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-28 12:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:53 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV49016%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for TV49016: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM04115%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for HM04115: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL39193%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for EL39193: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US61568%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for US61568: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH77322%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for WH77322: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for FD60498: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN36525%27 HTTP/1.1" 200 None
2026-03-28 12:01:53 [auto1.nl] INFO: Scrape type for VN36525: 0
2026-03-28 12:01:53 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-28 12:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:54 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM08403%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for PM08403: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX95579%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for LX95579: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK04481%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for KK04481: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT27619%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for GT27619: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for BU17435: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH97185%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for FH97185: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG50012%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for GG50012: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV31023%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for WV31023: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH92548%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for NH92548: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC46486%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for KC46486: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE07790%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for BE07790: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK39469%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for WK39469: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA53958%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for VA53958: 0
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-28 12:01:54 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-28 12:01:54 [auto1.nl] INFO: Scrape type for MF32327: 0
2026-03-28 12:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:55 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC37182%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for HC37182: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for AJ89396: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT04767%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for CT04767: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM27085%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for DM27085: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM90003%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for GM90003: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ58703%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for LZ58703: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX40194%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for DX40194: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB40041%27 HTTP/1.1" 200 None
2026-03-28 12:01:55 [auto1.nl] INFO: Scrape type for WB40041: 0
2026-03-28 12:01:55 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV51543%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for UV51543: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH11794%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for VH11794: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM39529%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for BM39529: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for CE53949: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX83153%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for EX83153: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX59899%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for DX59899: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS72354%27 HTTP/1.1" 200 None
2026-03-28 12:01:56 [auto1.nl] INFO: Scrape type for WS72354: 0
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-28 12:01:56 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-28 12:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:57 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL79871%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for NL79871: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM00486%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for WM00486: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM72619%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for YM72619: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL08717%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for EL08717: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for HF10176: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB01407%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for KB01407: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB67844%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for NB67844: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY02674%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for TY02674: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP30662%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for HP30662: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ83148%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for MZ83148: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF88410%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for TF88410: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK64597%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for YK64597: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM09418%27 HTTP/1.1" 200 None
2026-03-28 12:01:57 [auto1.nl] INFO: Scrape type for SM09418: 0
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-28 12:01:57 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-28 12:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:01:58 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 1045 | hits on page: 40
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL21960%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for TL21960: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV90025%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for MV90025: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG47676%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for UG47676: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE22840%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for AE22840: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU52252%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for WU52252: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV95890%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for DV95890: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG40185%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for FG40185: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ83628%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for GZ83628: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-28 12:01:58 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-28 12:01:58 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-28 12:01:59 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-28 12:01:59 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-28 12:01:59 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-28 12:01:59 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-28 12:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:00 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 1045 | hits on page: 40
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG63197%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for NG63197: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD56346%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for UD56346: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH96879%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for HH96879: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-28 12:02:00 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-28 12:02:00 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY79842%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.nl] INFO: Scrape type for NY79842: 0
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 12:02:01 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-28 12:02:01 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-28 12:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:02 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 1045 | hits on page: 40
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ92302%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for TJ92302: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK11532%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for JK11532: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK93829%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for HK93829: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for UY50656: 2
2026-03-28 12:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-28 12:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with scrape type 2
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with scrape type 2
2026-03-28 12:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d4cf50c9-964f-59d3-8fb8-81f2be8f9532, identifier: UY50656
2026-03-28 12:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-28 12:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-28 12:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656 to the API
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'petrol',
 'id': 'd4cf50c9-964f-59d3-8fb8-81f2be8f9532',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY50656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 396705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Saving data for UY50656: {'auction_closing_time': 1774714335.0, 'created_time': 1774612848.256076, 'last_price_update_time': 1774699322.78201}
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY50656') HTTP/1.1" 204 0
2026-03-28 12:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:02 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB63193%27 HTTP/1.1" 200 None
2026-03-28 12:02:02 [auto1.nl] INFO: Scrape type for FB63193: 2
2026-03-28 12:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193
2026-03-28 12:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2a70d3-ef31-5641-b052-e688b6b845c0 with scrape type 2
2026-03-28 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc2a70d3-ef31-5641-b052-e688b6b845c0 with scrape type 2
2026-03-28 12:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc2a70d3-ef31-5641-b052-e688b6b845c0, identifier: FB63193
2026-03-28 12:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193
2026-03-28 12:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193
2026-03-28 12:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193 to the API
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:20Z',
 'fuel_type': 'petrol',
 'id': 'fc2a70d3-ef31-5641-b052-e688b6b845c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB63193',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 235064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-17',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TGI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2014}
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB63193%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [auto1.nl] INFO: Saving data for FB63193: {'auction_closing_time': 1774715000.0, 'created_time': 1774612922.279587, 'last_price_update_time': 1774699323.31722}
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB63193') HTTP/1.1" 204 0
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [auto1.nl] INFO: Scrape type for SB99593: 2
2026-03-28 12:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-28 12:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba758880-b6e0-5a79-a87e-f00119eb694c with scrape type 2
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba758880-b6e0-5a79-a87e-f00119eb694c with scrape type 2
2026-03-28 12:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ba758880-b6e0-5a79-a87e-f00119eb694c, identifier: SB99593
2026-03-28 12:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-28 12:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-28 12:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593 to the API
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:18:18Z',
 'fuel_type': 'petrol',
 'id': 'ba758880-b6e0-5a79-a87e-f00119eb694c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB99593',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 237606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [auto1.nl] INFO: Saving data for SB99593: {'auction_closing_time': 1774714698.0, 'created_time': 1774612851.256512, 'last_price_update_time': 1774699323.719555}
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SB99593') HTTP/1.1" 204 0
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 12:02:03 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ87309%27 HTTP/1.1" 200 None
2026-03-28 12:02:03 [auto1.nl] INFO: Scrape type for JJ87309: 2
2026-03-28 12:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309
2026-03-28 12:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c1213c-d41e-50a7-a447-856ac758f05b with scrape type 2
2026-03-28 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c1213c-d41e-50a7-a447-856ac758f05b with scrape type 2
2026-03-28 12:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03c1213c-d41e-50a7-a447-856ac758f05b, identifier: JJ87309
2026-03-28 12:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309
2026-03-28 12:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309
2026-03-28 12:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309 to the API
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:29:19Z',
 'fuel_type': 'diesel',
 'id': '03c1213c-d41e-50a7-a447-856ac758f05b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ87309',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 256243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-25',
 'seller_name': None,
 'title': 'BMW X1 xDrive 23d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ87309%27 HTTP/1.1" 200 None
2026-03-28 12:02:04 [auto1.nl] INFO: Saving data for JJ87309: {'auction_closing_time': 1774715359.0, 'created_time': 1774612915.625626, 'last_price_update_time': 1774699324.108124}
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JJ87309') HTTP/1.1" 204 0
2026-03-28 12:02:04 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:04 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 1045 | hits on page: 40
2026-03-28 12:02:04 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-28 12:02:04 [auto1.nl] INFO: Scrape type for EY20513: 2
2026-03-28 12:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-28 12:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 277a7449-17f7-5d23-a41d-52df33e78d0d with scrape type 2
2026-03-28 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 277a7449-17f7-5d23-a41d-52df33e78d0d with scrape type 2
2026-03-28 12:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 277a7449-17f7-5d23-a41d-52df33e78d0d, identifier: EY20513
2026-03-28 12:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-28 12:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-28 12:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513 to the API
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:58:26Z',
 'fuel_type': 'petrol',
 'id': '277a7449-17f7-5d23-a41d-52df33e78d0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY20513',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 125362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-24',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2008}
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.nl] INFO: Saving data for EY20513: {'auction_closing_time': 1774717106.0, 'created_time': 1774612854.56335, 'last_price_update_time': 1774699325.252506}
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY20513') HTTP/1.1" 204 0
2026-03-28 12:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:05 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.nl] INFO: Scrape type for AE74076: 2
2026-03-28 12:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-28 12:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab50ad30-551e-593f-932a-277391e9665f with scrape type 2
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab50ad30-551e-593f-932a-277391e9665f with scrape type 2
2026-03-28 12:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ab50ad30-551e-593f-932a-277391e9665f, identifier: AE74076
2026-03-28 12:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-28 12:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-28 12:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076 to the API
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:17Z',
 'fuel_type': 'diesel',
 'id': 'ab50ad30-551e-593f-932a-277391e9665f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE74076',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 205570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-20',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.nl] INFO: Saving data for AE74076: {'auction_closing_time': 1774714877.0, 'created_time': 1773408608.229345, 'last_price_update_time': 1774699325.714964}
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE74076') HTTP/1.1" 204 0
2026-03-28 12:02:05 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-28 12:02:05 [auto1.nl] INFO: Scrape type for VA70092: 2
2026-03-28 12:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-28 12:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d2af2a-6313-5974-93fa-2234f5bbc454 with scrape type 2
2026-03-28 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d2af2a-6313-5974-93fa-2234f5bbc454 with scrape type 2
2026-03-28 12:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6d2af2a-6313-5974-93fa-2234f5bbc454, identifier: VA70092
2026-03-28 12:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-28 12:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-28 12:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092 to the API
2026-03-28 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:34:32Z',
 'fuel_type': 'petrol',
 'id': 'e6d2af2a-6313-5974-93fa-2234f5bbc454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA70092',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 97682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.nl] INFO: Saving data for VA70092: {'auction_closing_time': 1774715672.0, 'created_time': 1773946982.168265, 'last_price_update_time': 1774699326.127597}
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA70092') HTTP/1.1" 204 0
2026-03-28 12:02:06 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 12:02:06 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-28 12:02:06 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.nl] INFO: Scrape type for SA65575: 2
2026-03-28 12:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-28 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5637948d-a2e9-5b39-afb0-c2999649df09 with scrape type 2
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5637948d-a2e9-5b39-afb0-c2999649df09 with scrape type 2
2026-03-28 12:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5637948d-a2e9-5b39-afb0-c2999649df09, identifier: SA65575
2026-03-28 12:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-28 12:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-28 12:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575 to the API
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:11:36Z',
 'fuel_type': 'hybrid',
 'id': '5637948d-a2e9-5b39-afb0-c2999649df09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA65575',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-20',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.nl] INFO: Saving data for SA65575: {'auction_closing_time': 1774714296.0, 'created_time': 1774612856.649204, 'last_price_update_time': 1774699326.535725}
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA65575') HTTP/1.1" 204 0
2026-03-28 12:02:06 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-28 12:02:06 [auto1.nl] INFO: Scrape type for PD24155: 2
2026-03-28 12:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-28 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with scrape type 2
2026-03-28 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with scrape type 2
2026-03-28 12:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e, identifier: PD24155
2026-03-28 12:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 12:02:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-28 12:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155 to the API
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'petrol',
 'id': 'a85fc4b1-7efd-526b-9ac5-a5cb6113a84e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD24155',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 274592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-08',
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-28 12:02:07 [auto1.nl] INFO: Saving data for PD24155: {'auction_closing_time': 1774714609.0, 'created_time': 1774612917.829419, 'last_price_update_time': 1774699327.072209}
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PD24155') HTTP/1.1" 204 0
2026-03-28 12:02:07 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-28 12:02:07 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-28 12:02:07 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS58210%27 HTTP/1.1" 200 None
2026-03-28 12:02:07 [auto1.nl] INFO: Scrape type for WS58210: 2
2026-03-28 12:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210
2026-03-28 12:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801aae17-b240-55c5-a7ff-feed6976a1dc with scrape type 2
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 801aae17-b240-55c5-a7ff-feed6976a1dc with scrape type 2
2026-03-28 12:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 801aae17-b240-55c5-a7ff-feed6976a1dc, identifier: WS58210
2026-03-28 12:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210
2026-03-28 12:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210
2026-03-28 12:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210 to the API
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:49:48Z',
 'fuel_type': 'electro',
 'id': '801aae17-b240-55c5-a7ff-feed6976a1dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS58210',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 51655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 107 kW Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2022}
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS58210%27 HTTP/1.1" 200 None
2026-03-28 12:02:07 [auto1.nl] INFO: Saving data for WS58210: {'auction_closing_time': 1774716588.0, 'created_time': 1774612925.667135, 'last_price_update_time': 1774699327.494437}
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS58210') HTTP/1.1" 204 0
2026-03-28 12:02:07 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-28 12:02:07 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US57687%27 HTTP/1.1" 200 None
2026-03-28 12:02:07 [auto1.nl] INFO: Scrape type for US57687: 2
2026-03-28 12:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687
2026-03-28 12:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83e27d-321a-5d90-9779-1e29536a61c2 with scrape type 2
2026-03-28 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a83e27d-321a-5d90-9779-1e29536a61c2 with scrape type 2
2026-03-28 12:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a83e27d-321a-5d90-9779-1e29536a61c2, identifier: US57687
2026-03-28 12:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687
2026-03-28 12:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687
2026-03-28 12:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687 to the API
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:32:46Z',
 'fuel_type': 'electro',
 'id': '1a83e27d-321a-5d90-9779-1e29536a61c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US57687',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 52816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-10',
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US57687%27 HTTP/1.1" 200 None
2026-03-28 12:02:07 [auto1.nl] INFO: Saving data for US57687: {'auction_closing_time': 1774715566.0, 'created_time': 1774612916.453957, 'last_price_update_time': 1774699327.913386}
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='US57687') HTTP/1.1" 204 0
2026-03-28 12:02:08 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-28 12:02:08 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 12:02:08 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 12:02:08 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-28 12:02:08 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB05434%27 HTTP/1.1" 200 None
2026-03-28 12:02:08 [auto1.nl] INFO: Scrape type for AB05434: 2
2026-03-28 12:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434
2026-03-28 12:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with scrape type 2
2026-03-28 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with scrape type 2
2026-03-28 12:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026, identifier: AB05434
2026-03-28 12:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434
2026-03-28 12:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434
2026-03-28 12:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434 to the API
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-28T16:35:06Z',
 'fuel_type': 'petrol',
 'id': 'ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB05434',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 190937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-06',
 'seller_name': None,
 'title': 'Volvo XC90 3.2 Momentum Geartronic',
 'transmission': 'automatic',
 'trim': 'Momentum Geartronic',
 'year': 2007}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB05434%27 HTTP/1.1" 200 None
2026-03-28 12:02:08 [auto1.nl] INFO: Saving data for AB05434: {'auction_closing_time': 1774715706.0, 'created_time': 1774612917.479029, 'last_price_update_time': 1774699328.436736}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB05434') HTTP/1.1" 204 0
2026-03-28 12:02:08 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-28 12:02:08 [auto1.nl] INFO: Scrape type for HY50584: 2
2026-03-28 12:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-28 12:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with scrape type 2
2026-03-28 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with scrape type 2
2026-03-28 12:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed, identifier: HY50584
2026-03-28 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-28 12:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-28 12:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584 to the API
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:54:41Z',
 'fuel_type': 'hybrid',
 'id': 'a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY50584',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 129771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-04',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Flow',
 'transmission': 'automatic',
 'trim': 'Flow',
 'year': 2017}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-28 12:02:08 [auto1.nl] INFO: Saving data for HY50584: {'auction_closing_time': 1774716881.0, 'created_time': 1774612872.583904, 'last_price_update_time': 1774699328.829028}
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HY50584') HTTP/1.1" 204 0
2026-03-28 12:02:08 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-28 12:02:08 [auto1.nl] INFO: Scrape type for BD38212: 2
2026-03-28 12:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-28 12:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f626f2aa-bd02-5806-afd1-4a4942fb0066 with scrape type 2
2026-03-28 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f626f2aa-bd02-5806-afd1-4a4942fb0066 with scrape type 2
2026-03-28 12:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f626f2aa-bd02-5806-afd1-4a4942fb0066, identifier: BD38212
2026-03-28 12:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-28 12:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-28 12:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212 to the API
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:13:08Z',
 'fuel_type': 'petrol',
 'id': 'f626f2aa-bd02-5806-afd1-4a4942fb0066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD38212',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 118750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-28 12:02:09 [auto1.nl] INFO: Saving data for BD38212: {'auction_closing_time': 1774714388.0, 'created_time': 1773133233.390175, 'last_price_update_time': 1774699329.214295}
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD38212') HTTP/1.1" 204 0
2026-03-28 12:02:09 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-28 12:02:09 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-28 12:02:09 [auto1.nl] INFO: Scrape type for LG57021: 2
2026-03-28 12:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-28 12:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0862ad0-f3eb-504c-a902-f2ac95ab4200 with scrape type 2
2026-03-28 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0862ad0-f3eb-504c-a902-f2ac95ab4200 with scrape type 2
2026-03-28 12:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d0862ad0-f3eb-504c-a902-f2ac95ab4200, identifier: LG57021
2026-03-28 12:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-28 12:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-28 12:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021 to the API
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:48:08Z',
 'fuel_type': 'petrol',
 'id': 'd0862ad0-f3eb-504c-a902-f2ac95ab4200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG57021',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 156246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-16',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 240 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-28 12:02:09 [auto1.nl] INFO: Saving data for LG57021: {'auction_closing_time': 1774716488.0, 'created_time': 1774612921.177823, 'last_price_update_time': 1774699329.630523}
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG57021') HTTP/1.1" 204 0
2026-03-28 12:02:09 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 1045 | hits on page: 40
2026-03-28 12:02:09 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-28 12:02:09 [auto1.nl] INFO: Scrape type for DK58919: 2
2026-03-28 12:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-28 12:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c3fcff-a822-538d-96be-9ad21dd66132 with scrape type 2
2026-03-28 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c3fcff-a822-538d-96be-9ad21dd66132 with scrape type 2
2026-03-28 12:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78c3fcff-a822-538d-96be-9ad21dd66132, identifier: DK58919
2026-03-28 12:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-28 12:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-28 12:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919 to the API
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:36:31Z',
 'fuel_type': 'diesel',
 'id': '78c3fcff-a822-538d-96be-9ad21dd66132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK58919',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 171371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-15',
 'seller_name': None,
 'title': 'Opel Vivaro 1.9 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2003}
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [auto1.nl] INFO: Saving data for DK58919: {'auction_closing_time': 1774715791.0, 'created_time': 1773231838.862376, 'last_price_update_time': 1774699330.051014}
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK58919') HTTP/1.1" 204 0
2026-03-28 12:02:10 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC04146%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [auto1.nl] INFO: Scrape type for UC04146: 2
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4960974-a60a-52ae-b22c-c15f6cd95b9c with scrape type 2
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4960974-a60a-52ae-b22c-c15f6cd95b9c with scrape type 2
2026-03-28 12:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f4960974-a60a-52ae-b22c-c15f6cd95b9c, identifier: UC04146
2026-03-28 12:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:10 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55872%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [auto1.nl] INFO: Scrape type for EF55872: 0
2026-03-28 12:02:10 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-28 12:02:10 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ45732%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [auto1.nl] INFO: Scrape type for TJ45732: 0
2026-03-28 12:02:10 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-28 12:02:10 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 12:02:10 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [auto1.nl] INFO: Scrape type for GA80832: 2
2026-03-28 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-28 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with scrape type 2
2026-03-28 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with scrape type 2
2026-03-28 12:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b28fb79-b976-5d94-ad37-1ad21ed15f92, identifier: GA80832
2026-03-28 12:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146
2026-03-28 12:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146
2026-03-28 12:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146 to the API
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'petrol',
 'id': 'f4960974-a60a-52ae-b22c-c15f6cd95b9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC04146',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 216917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-10',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC04146%27 HTTP/1.1" 200 None
2026-03-28 12:02:10 [auto1.nl] INFO: Saving data for UC04146: {'auction_closing_time': 1774716882.0, 'created_time': 1774612903.73224, 'last_price_update_time': 1774699330.628987}
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC04146') HTTP/1.1" 204 0
2026-03-28 12:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-28 12:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-28 12:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832 to the API
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:00:36Z',
 'fuel_type': 'diesel',
 'id': '6b28fb79-b976-5d94-ad37-1ad21ed15f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA80832',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 134652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-12',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2016}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Saving data for GA80832: {'auction_closing_time': 1774713636.0, 'created_time': 1774353842.385482, 'last_price_update_time': 1774699331.015594}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA80832') HTTP/1.1" 204 0
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB37816%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Scrape type for UB37816: 2
2026-03-28 12:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816
2026-03-28 12:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b490cb09-3e3c-54bf-b8a4-06e5a114cddf with scrape type 2
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b490cb09-3e3c-54bf-b8a4-06e5a114cddf with scrape type 2
2026-03-28 12:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b490cb09-3e3c-54bf-b8a4-06e5a114cddf, identifier: UB37816
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Scrape type for UT08140: 2
2026-03-28 12:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140
2026-03-28 12:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 468f2b31-f3cb-50e4-ba65-71281ebf71ef with scrape type 2
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 468f2b31-f3cb-50e4-ba65-71281ebf71ef with scrape type 2
2026-03-28 12:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 468f2b31-f3cb-50e4-ba65-71281ebf71ef, identifier: UT08140
2026-03-28 12:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816
2026-03-28 12:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816
2026-03-28 12:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816 to the API
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:10:54Z',
 'fuel_type': 'petrol',
 'id': 'b490cb09-3e3c-54bf-b8a4-06e5a114cddf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB37816',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 162613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB37816%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Saving data for UB37816: {'auction_closing_time': 1774714254.0, 'created_time': 1773775073.019735, 'last_price_update_time': 1774699331.535155}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB37816') HTTP/1.1" 204 0
2026-03-28 12:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140
2026-03-28 12:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140
2026-03-28 12:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140 to the API
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:15:31Z',
 'fuel_type': 'petrol',
 'id': '468f2b31-f3cb-50e4-ba65-71281ebf71ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT08140',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 301636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-02',
 'seller_name': None,
 'title': 'Volvo V70 2.4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2005}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Saving data for UT08140: {'auction_closing_time': 1774714531.0, 'created_time': 1773947235.671376, 'last_price_update_time': 1774699331.824035}
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UT08140') HTTP/1.1" 204 0
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Scrape type for GX38555: 2
2026-03-28 12:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555
2026-03-28 12:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bc6a37-99ac-5b61-b281-99edb0a170a8 with scrape type 2
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26bc6a37-99ac-5b61-b281-99edb0a170a8 with scrape type 2
2026-03-28 12:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 26bc6a37-99ac-5b61-b281-99edb0a170a8, identifier: GX38555
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 12:02:11 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-28 12:02:11 [auto1.nl] INFO: Scrape type for SD33545: 2
2026-03-28 12:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-28 12:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb68523d-d7ee-5239-af35-c043bb1fa1da with scrape type 2
2026-03-28 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb68523d-d7ee-5239-af35-c043bb1fa1da with scrape type 2
2026-03-28 12:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb68523d-d7ee-5239-af35-c043bb1fa1da, identifier: SD33545
2026-03-28 12:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555
2026-03-28 12:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555
2026-03-28 12:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555 to the API
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:16:54Z',
 'fuel_type': 'petrol',
 'id': '26bc6a37-99ac-5b61-b281-99edb0a170a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX38555',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 239004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-15',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [auto1.nl] INFO: Saving data for GX38555: {'auction_closing_time': 1774714614.0, 'created_time': 1774612902.244104, 'last_price_update_time': 1774699332.297455}
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX38555') HTTP/1.1" 204 0
2026-03-28 12:02:12 [scrapy.extensions.logstats] INFO: Crawled 138 pages (at 46 pages/min), scraped 84 items (at 51 items/min)
2026-03-28 12:02:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 12:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-28 12:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-28 12:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545 to the API
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:03Z',
 'fuel_type': 'petrol',
 'id': 'fb68523d-d7ee-5239-af35-c043bb1fa1da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD33545',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 111362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [auto1.nl] INFO: Saving data for SD33545: {'auction_closing_time': 1774715823.0, 'created_time': 1774612919.676882, 'last_price_update_time': 1774699332.676302}
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD33545') HTTP/1.1" 204 0
2026-03-28 12:02:12 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-28 12:02:12 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-28 12:02:12 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-28 12:02:12 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 12:02:12 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 12:02:12 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [auto1.nl] INFO: Scrape type for RN50601: 2
2026-03-28 12:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-28 12:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da26612-6df4-597e-8da2-c3e32bde619a with scrape type 2
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da26612-6df4-597e-8da2-c3e32bde619a with scrape type 2
2026-03-28 12:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4da26612-6df4-597e-8da2-c3e32bde619a, identifier: RN50601
2026-03-28 12:02:12 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-28 12:02:12 [auto1.nl] INFO: Scrape type for JC35078: 2
2026-03-28 12:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-28 12:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with scrape type 2
2026-03-28 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with scrape type 2
2026-03-28 12:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af, identifier: JC35078
2026-03-28 12:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-28 12:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-28 12:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601 to the API
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:04Z',
 'fuel_type': 'petrol',
 'id': '4da26612-6df4-597e-8da2-c3e32bde619a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN50601',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 103484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [auto1.nl] INFO: Saving data for RN50601: {'auction_closing_time': 1774716544.0, 'created_time': 1774612891.78819, 'last_price_update_time': 1774699333.212237}
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RN50601') HTTP/1.1" 204 0
2026-03-28 12:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-28 12:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-28 12:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078 to the API
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-28T16:35:53Z',
 'fuel_type': 'petrol',
 'id': '83c358ee-d5b0-5bbc-8153-04a51ec4c1af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC35078',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 135975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2015}
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [auto1.nl] INFO: Saving data for JC35078: {'auction_closing_time': 1774715753.0, 'created_time': 1774612875.200698, 'last_price_update_time': 1774699333.498738}
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC35078') HTTP/1.1" 204 0
2026-03-28 12:02:13 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [auto1.nl] INFO: Scrape type for XJ87481: 2
2026-03-28 12:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-28 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028a42f1-9ffa-50d6-a30b-fed070358151 with scrape type 2
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028a42f1-9ffa-50d6-a30b-fed070358151 with scrape type 2
2026-03-28 12:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 028a42f1-9ffa-50d6-a30b-fed070358151, identifier: XJ87481
2026-03-28 12:02:13 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-28 12:02:13 [auto1.nl] INFO: Scrape type for LX89920: 2
2026-03-28 12:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-28 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with scrape type 2
2026-03-28 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with scrape type 2
2026-03-28 12:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3, identifier: LX89920
2026-03-28 12:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-28 12:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-28 12:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481 to the API
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:18:59Z',
 'fuel_type': 'petrol',
 'id': '028a42f1-9ffa-50d6-a30b-fed070358151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ87481',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 86841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2020}
2026-03-28 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.nl] INFO: Saving data for XJ87481: {'auction_closing_time': 1774714739.0, 'created_time': 1773132399.825246, 'last_price_update_time': 1774699334.002252}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ87481') HTTP/1.1" 204 0
2026-03-28 12:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-28 12:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-28 12:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920 to the API
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:58:10Z',
 'fuel_type': 'hybrid',
 'id': '03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX89920',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 51528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.nl] INFO: Saving data for LX89920: {'auction_closing_time': 1774717090.0, 'created_time': 1774612906.852293, 'last_price_update_time': 1774699334.293942}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX89920') HTTP/1.1" 204 0
2026-03-28 12:02:14 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 12:02:14 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.nl] INFO: Scrape type for NL71418: 2
2026-03-28 12:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-28 12:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with scrape type 2
2026-03-28 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with scrape type 2
2026-03-28 12:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963, identifier: NL71418
2026-03-28 12:02:14 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY14996%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.nl] INFO: Scrape type for LY14996: 2
2026-03-28 12:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996
2026-03-28 12:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 196f2cb0-434f-52b9-bc64-560496d53918 with scrape type 2
2026-03-28 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 196f2cb0-434f-52b9-bc64-560496d53918 with scrape type 2
2026-03-28 12:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 196f2cb0-434f-52b9-bc64-560496d53918, identifier: LY14996
2026-03-28 12:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-28 12:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-28 12:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418 to the API
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:40:06Z',
 'fuel_type': 'petrol',
 'id': '7a4a1b86-6d0e-5cfd-8018-5fe9da422963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL71418',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 229363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-01',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Comfort',
 'transmission': 'automatic',
 'trim': 'Sport Comfort',
 'year': 2004}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-28 12:02:14 [auto1.nl] INFO: Saving data for NL71418: {'auction_closing_time': 1774716006.0, 'created_time': 1774612902.831196, 'last_price_update_time': 1774699334.787599}
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL71418') HTTP/1.1" 204 0
2026-03-28 12:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996
2026-03-28 12:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996
2026-03-28 12:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996 to the API
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:59:23Z',
 'fuel_type': 'petrol',
 'id': '196f2cb0-434f-52b9-bc64-560496d53918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY14996',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 201367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-01',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 B-Easy',
 'transmission': 'manual',
 'trim': 'B-Easy',
 'year': 2014}
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY14996%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [auto1.nl] INFO: Saving data for LY14996: {'auction_closing_time': 1774717163.0, 'created_time': 1774612898.840138, 'last_price_update_time': 1774699335.216167}
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LY14996') HTTP/1.1" 204 0
2026-03-28 12:02:15 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 12:02:15 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [auto1.nl] INFO: Scrape type for UB57166: 2
2026-03-28 12:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-28 12:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 242474bf-1533-5340-8d9d-3ada2cd998ff with scrape type 2
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 242474bf-1533-5340-8d9d-3ada2cd998ff with scrape type 2
2026-03-28 12:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 242474bf-1533-5340-8d9d-3ada2cd998ff, identifier: UB57166
2026-03-28 12:02:15 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-28 12:02:15 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [auto1.nl] INFO: Scrape type for CX26987: 2
2026-03-28 12:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-28 12:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f461c9-4265-55cb-bcc0-023d3dc18d5d with scrape type 2
2026-03-28 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f461c9-4265-55cb-bcc0-023d3dc18d5d with scrape type 2
2026-03-28 12:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96f461c9-4265-55cb-bcc0-023d3dc18d5d, identifier: CX26987
2026-03-28 12:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-28 12:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-28 12:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166 to the API
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:56:20Z',
 'fuel_type': 'diesel',
 'id': '242474bf-1533-5340-8d9d-3ada2cd998ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB57166',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 184528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-05',
 'seller_name': None,
 'title': "Kia cee'd 1.4 CRDi Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2013}
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-28 12:02:15 [auto1.nl] INFO: Saving data for UB57166: {'auction_closing_time': 1774716980.0, 'created_time': 1773135283.127139, 'last_price_update_time': 1774699335.802568}
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB57166') HTTP/1.1" 204 0
2026-03-28 12:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-28 12:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-28 12:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987 to the API
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:04:47Z',
 'fuel_type': 'petrol',
 'id': '96f461c9-4265-55cb-bcc0-023d3dc18d5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX26987',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 61131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [auto1.nl] INFO: Saving data for CX26987: {'auction_closing_time': 1774713887.0, 'created_time': 1774612881.636129, 'last_price_update_time': 1774699336.092056}
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX26987') HTTP/1.1" 204 0
2026-03-28 12:02:16 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU82988%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [auto1.nl] INFO: Scrape type for YU82988: 2
2026-03-28 12:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988
2026-03-28 12:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b15081e2-0adb-56ce-968a-e014ad60e99a with scrape type 2
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b15081e2-0adb-56ce-968a-e014ad60e99a with scrape type 2
2026-03-28 12:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b15081e2-0adb-56ce-968a-e014ad60e99a, identifier: YU82988
2026-03-28 12:02:16 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 12:02:16 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [auto1.nl] INFO: Scrape type for FU31497: 2
2026-03-28 12:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-28 12:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with scrape type 2
2026-03-28 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with scrape type 2
2026-03-28 12:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c, identifier: FU31497
2026-03-28 12:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988
2026-03-28 12:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988
2026-03-28 12:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988 to the API
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:46Z',
 'fuel_type': 'petrol',
 'id': 'b15081e2-0adb-56ce-968a-e014ad60e99a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU82988',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 117872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU82988%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [auto1.nl] INFO: Saving data for YU82988: {'auction_closing_time': 1774714726.0, 'created_time': 1774612908.636753, 'last_price_update_time': 1774699336.619853}
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU82988') HTTP/1.1" 204 0
2026-03-28 12:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-28 12:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-28 12:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497 to the API
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:06Z',
 'fuel_type': 'petrol',
 'id': '6296cd2c-5077-56d2-a288-7c9dc3d0df5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU31497',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 101593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-28 12:02:16 [auto1.nl] INFO: Saving data for FU31497: {'auction_closing_time': 1774715706.0, 'created_time': 1774612911.617417, 'last_price_update_time': 1774699336.969316}
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FU31497') HTTP/1.1" 204 0
2026-03-28 12:02:16 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-28 12:02:17 [auto1.nl] INFO: Scrape type for WD65994: 2
2026-03-28 12:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-28 12:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7339da98-f9dd-5833-ad9c-585f264bbece with scrape type 2
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7339da98-f9dd-5833-ad9c-585f264bbece with scrape type 2
2026-03-28 12:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7339da98-f9dd-5833-ad9c-585f264bbece, identifier: WD65994
2026-03-28 12:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-28 12:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-28 12:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994 to the API
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:31Z',
 'fuel_type': 'petrol',
 'id': '7339da98-f9dd-5833-ad9c-585f264bbece',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD65994',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 263960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-09',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-28 12:02:17 [auto1.nl] INFO: Saving data for WD65994: {'auction_closing_time': 1774716091.0, 'created_time': 1773836967.795693, 'last_price_update_time': 1774699337.375254}
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WD65994') HTTP/1.1" 204 0
2026-03-28 12:02:17 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-28 12:02:17 [auto1.nl] INFO: Scrape type for GS47094: 2
2026-03-28 12:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-28 12:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224473c8-ce88-5d83-939f-aac48135da14 with scrape type 2
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224473c8-ce88-5d83-939f-aac48135da14 with scrape type 2
2026-03-28 12:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 224473c8-ce88-5d83-939f-aac48135da14, identifier: GS47094
2026-03-28 12:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-28 12:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-28 12:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094 to the API
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:50:50Z',
 'fuel_type': 'petrol',
 'id': '224473c8-ce88-5d83-939f-aac48135da14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS47094',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 104966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-28 12:02:17 [auto1.nl] INFO: Saving data for GS47094: {'auction_closing_time': 1774716650.0, 'created_time': 1773688145.394938, 'last_price_update_time': 1774699337.81697}
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS47094') HTTP/1.1" 204 0
2026-03-28 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:17 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-28 12:02:17 [auto1.nl] INFO: Scrape type for LH66044: 2
2026-03-28 12:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-28 12:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 403fad5d-d905-5b73-babd-73a4fc03a4b2 with scrape type 2
2026-03-28 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 403fad5d-d905-5b73-babd-73a4fc03a4b2 with scrape type 2
2026-03-28 12:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 403fad5d-d905-5b73-babd-73a4fc03a4b2, identifier: LH66044
2026-03-28 12:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-28 12:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-28 12:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044 to the API
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:09Z',
 'fuel_type': 'diesel',
 'id': '403fad5d-d905-5b73-babd-73a4fc03a4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH66044',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 280431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-29',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Linje Classic',
 'transmission': 'manual',
 'trim': 'Linje Classic',
 'year': 2015}
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-28 12:02:18 [auto1.nl] INFO: Saving data for LH66044: {'auction_closing_time': 1774714749.0, 'created_time': 1773514831.760093, 'last_price_update_time': 1774699338.228182}
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH66044') HTTP/1.1" 204 0
2026-03-28 12:02:18 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-28 12:02:18 [auto1.nl] INFO: Scrape type for XA85497: 2
2026-03-28 12:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-28 12:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105ffac9-32f7-5baf-a4dc-41031fe00db7 with scrape type 2
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 105ffac9-32f7-5baf-a4dc-41031fe00db7 with scrape type 2
2026-03-28 12:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 105ffac9-32f7-5baf-a4dc-41031fe00db7, identifier: XA85497
2026-03-28 12:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-28 12:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-28 12:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497 to the API
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:31:59Z',
 'fuel_type': 'diesel',
 'id': '105ffac9-32f7-5baf-a4dc-41031fe00db7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA85497',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 280658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Business 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Business 2WD',
 'year': 2015}
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-28 12:02:18 [auto1.nl] INFO: Saving data for XA85497: {'auction_closing_time': 1774715519.0, 'created_time': 1773135052.806749, 'last_price_update_time': 1774699338.648301}
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XA85497') HTTP/1.1" 204 0
2026-03-28 12:02:18 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-28 12:02:18 [auto1.nl] INFO: Scrape type for CG77801: 2
2026-03-28 12:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-28 12:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d12a5345-0774-5d5d-8419-10744b816bf5 with scrape type 2
2026-03-28 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d12a5345-0774-5d5d-8419-10744b816bf5 with scrape type 2
2026-03-28 12:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d12a5345-0774-5d5d-8419-10744b816bf5, identifier: CG77801
2026-03-28 12:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-28 12:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-28 12:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801 to the API
2026-03-28 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:27:20Z',
 'fuel_type': 'diesel',
 'id': 'd12a5345-0774-5d5d-8419-10744b816bf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG77801',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 214505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.3 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [auto1.nl] INFO: Saving data for CG77801: {'auction_closing_time': 1774715240.0, 'created_time': 1773134959.801317, 'last_price_update_time': 1774699339.178026}
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG77801') HTTP/1.1" 204 0
2026-03-28 12:02:19 [auto1.nl] INFO: Channel: 24h | Page: 25 | totalHits: 1045 | hits on page: 40
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [auto1.nl] INFO: Scrape type for PP29341: 2
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with scrape type 2
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with scrape type 2
2026-03-28 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e63cf1c0-3b16-5c7a-a8b5-88546cd74822, identifier: PP29341
2026-03-28 12:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-28 12:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-28 12:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341 to the API
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'petrol',
 'id': 'e63cf1c0-3b16-5c7a-a8b5-88546cd74822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP29341',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 182562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-23',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2005}
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [auto1.nl] INFO: Saving data for PP29341: {'auction_closing_time': 1774714816.0, 'created_time': 1774094520.819926, 'last_price_update_time': 1774699339.598492}
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PP29341') HTTP/1.1" 204 0
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RR80165%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [auto1.nl] INFO: Scrape type for RR80165: 2
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6456eb-d795-5df0-9111-f24d5434d664 with scrape type 2
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6456eb-d795-5df0-9111-f24d5434d664 with scrape type 2
2026-03-28 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0d6456eb-d795-5df0-9111-f24d5434d664, identifier: RR80165
2026-03-28 12:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 12:02:19 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-28 12:02:19 [auto1.nl] INFO: Scrape type for WR76222: 2
2026-03-28 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-28 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36efc695-9723-5bbd-905a-b337eba2b624 with scrape type 2
2026-03-28 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36efc695-9723-5bbd-905a-b337eba2b624 with scrape type 2
2026-03-28 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36efc695-9723-5bbd-905a-b337eba2b624, identifier: WR76222
2026-03-28 12:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165
2026-03-28 12:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165
2026-03-28 12:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165 to the API
2026-03-28 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:11:05Z',
 'fuel_type': 'petrol',
 'id': '0d6456eb-d795-5df0-9111-f24d5434d664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR80165',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 157384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-22',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S Sidewalk',
 'transmission': 'automatic',
 'trim': 'Sidewalk',
 'year': 2008}
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RR80165%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [auto1.nl] INFO: Saving data for RR80165: {'auction_closing_time': 1774714265.0, 'created_time': 1773229343.79814, 'last_price_update_time': 1774699340.121741}
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RR80165') HTTP/1.1" 204 0
2026-03-28 12:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-28 12:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-28 12:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222 to the API
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:02:10Z',
 'fuel_type': 'hybrid',
 'id': '36efc695-9723-5bbd-905a-b337eba2b624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR76222',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 246899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-27',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [auto1.nl] INFO: Saving data for WR76222: {'auction_closing_time': 1774713730.0, 'created_time': 1773231502.89427, 'last_price_update_time': 1774699340.51331}
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WR76222') HTTP/1.1" 204 0
2026-03-28 12:02:20 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 12:02:20 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 12:02:20 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-28 12:02:20 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 12:02:20 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 12:02:20 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [auto1.nl] INFO: Scrape type for FB46775: 2
2026-03-28 12:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-28 12:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with scrape type 2
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with scrape type 2
2026-03-28 12:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a680d4a3-dea7-5c80-9818-7e0b3b2ed048, identifier: FB46775
2026-03-28 12:02:20 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-28 12:02:20 [auto1.nl] INFO: Scrape type for ME73088: 2
2026-03-28 12:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-28 12:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with scrape type 2
2026-03-28 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with scrape type 2
2026-03-28 12:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 345d9a56-61ba-57e4-b1c5-17f279b7ada9, identifier: ME73088
2026-03-28 12:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-28 12:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-28 12:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775 to the API
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:54:44Z',
 'fuel_type': 'hybrid',
 'id': 'a680d4a3-dea7-5c80-9818-7e0b3b2ed048',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB46775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 44926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [auto1.nl] INFO: Saving data for FB46775: {'auction_closing_time': 1774716884.0, 'created_time': 1774292591.856896, 'last_price_update_time': 1774699341.04121}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB46775') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-28 12:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-28 12:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088 to the API
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:13:20Z',
 'fuel_type': 'diesel',
 'id': '345d9a56-61ba-57e4-b1c5-17f279b7ada9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME73088',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 175572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-11',
 'seller_name': None,
 'title': 'Citroen C3 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [auto1.nl] INFO: Saving data for ME73088: {'auction_closing_time': 1774714400.0, 'created_time': 1774612895.277212, 'last_price_update_time': 1774699341.348819}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME73088') HTTP/1.1" 204 0
2026-03-28 12:02:21 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [auto1.nl] INFO: Scrape type for LG18300: 2
2026-03-28 12:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-28 12:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916443fa-fa92-5806-9155-9fc77689165c with scrape type 2
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 916443fa-fa92-5806-9155-9fc77689165c with scrape type 2
2026-03-28 12:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 916443fa-fa92-5806-9155-9fc77689165c, identifier: LG18300
2026-03-28 12:02:21 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [auto1.nl] INFO: Scrape type for UJ24113: 2
2026-03-28 12:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-28 12:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with scrape type 2
2026-03-28 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with scrape type 2
2026-03-28 12:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d, identifier: UJ24113
2026-03-28 12:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-28 12:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-28 12:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300 to the API
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:04Z',
 'fuel_type': 'petrol',
 'id': '916443fa-fa92-5806-9155-9fc77689165c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG18300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-28 12:02:21 [auto1.nl] INFO: Saving data for LG18300: {'auction_closing_time': 1774714504.0, 'created_time': 1773688236.711237, 'last_price_update_time': 1774699341.918633}
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG18300') HTTP/1.1" 204 0
2026-03-28 12:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-28 12:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-28 12:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113 to the API
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:38:38Z',
 'fuel_type': 'petrol',
 'id': 'f8ba5787-5f2e-51ae-a90f-2f4e2a08607d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ24113',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 69078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-28 12:02:22 [auto1.nl] INFO: Saving data for UJ24113: {'auction_closing_time': 1774715918.0, 'created_time': 1774267367.165865, 'last_price_update_time': 1774699342.217172}
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ24113') HTTP/1.1" 204 0
2026-03-28 12:02:22 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-28 12:02:22 [auto1.nl] INFO: Scrape type for FX92385: 2
2026-03-28 12:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385
2026-03-28 12:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c5baad-2743-54f1-b22a-83e60a7b3e8c with scrape type 2
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c5baad-2743-54f1-b22a-83e60a7b3e8c with scrape type 2
2026-03-28 12:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 06c5baad-2743-54f1-b22a-83e60a7b3e8c, identifier: FX92385
2026-03-28 12:02:22 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-28 12:02:22 [auto1.nl] INFO: Scrape type for BC03068: 2
2026-03-28 12:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-28 12:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4657347b-0760-5e83-b9da-2506de5a3f41 with scrape type 2
2026-03-28 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4657347b-0760-5e83-b9da-2506de5a3f41 with scrape type 2
2026-03-28 12:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4657347b-0760-5e83-b9da-2506de5a3f41, identifier: BC03068
2026-03-28 12:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385
2026-03-28 12:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385
2026-03-28 12:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385 to the API
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:21:48Z',
 'fuel_type': 'petrol',
 'id': '06c5baad-2743-54f1-b22a-83e60a7b3e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX92385',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 90840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-28 12:02:22 [auto1.nl] INFO: Saving data for FX92385: {'auction_closing_time': 1774714908.0, 'created_time': 1773134253.452387, 'last_price_update_time': 1774699342.740706}
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FX92385') HTTP/1.1" 204 0
2026-03-28 12:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-28 12:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-28 12:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068 to the API
2026-03-28 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-28T16:22:34Z',
 'fuel_type': 'petrol',
 'id': '4657347b-0760-5e83-b9da-2506de5a3f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC03068',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 120866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Si4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.nl] INFO: Saving data for BC03068: {'auction_closing_time': 1774714954.0, 'created_time': 1773342622.085241, 'last_price_update_time': 1774699343.152478}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC03068') HTTP/1.1" 204 0
2026-03-28 12:02:23 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.nl] INFO: Scrape type for JA96094: 2
2026-03-28 12:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-28 12:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f998d16-defa-5ffb-9e97-14c2372f574d with scrape type 2
2026-03-28 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f998d16-defa-5ffb-9e97-14c2372f574d with scrape type 2
2026-03-28 12:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9f998d16-defa-5ffb-9e97-14c2372f574d, identifier: JA96094
2026-03-28 12:02:23 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 12:02:23 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.nl] INFO: Scrape type for YN14337: 2
2026-03-28 12:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-28 12:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb566f2-7ec2-5de5-8b5f-2d829148d758 with scrape type 2
2026-03-28 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb566f2-7ec2-5de5-8b5f-2d829148d758 with scrape type 2
2026-03-28 12:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ffb566f2-7ec2-5de5-8b5f-2d829148d758, identifier: YN14337
2026-03-28 12:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-28 12:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-28 12:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094 to the API
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:12:56Z',
 'fuel_type': 'petrol',
 'id': '9f998d16-defa-5ffb-9e97-14c2372f574d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA96094',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 263681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-04',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.nl] INFO: Saving data for JA96094: {'auction_closing_time': 1774714376.0, 'created_time': 1774094522.883026, 'last_price_update_time': 1774699343.637878}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA96094') HTTP/1.1" 204 0
2026-03-28 12:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-28 12:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-28 12:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337 to the API
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:49:00Z',
 'fuel_type': 'petrol',
 'id': 'ffb566f2-7ec2-5de5-8b5f-2d829148d758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN14337',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 187042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.nl] INFO: Saving data for YN14337: {'auction_closing_time': 1774716540.0, 'created_time': 1773134922.681851, 'last_price_update_time': 1774699343.925271}
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN14337') HTTP/1.1" 204 0
2026-03-28 12:02:23 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 12:02:23 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-28 12:02:23 [auto1.nl] INFO: Scrape type for XV01386: 2
2026-03-28 12:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-28 12:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with scrape type 2
2026-03-28 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with scrape type 2
2026-03-28 12:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 584ceb9e-5605-5102-b1d0-e5ade31e20e9, identifier: XV01386
2026-03-28 12:02:24 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.nl] INFO: Scrape type for VM29173: 2
2026-03-28 12:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-28 12:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84e3317-ddd1-523b-9a75-a66dcc4b3359 with scrape type 2
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84e3317-ddd1-523b-9a75-a66dcc4b3359 with scrape type 2
2026-03-28 12:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f84e3317-ddd1-523b-9a75-a66dcc4b3359, identifier: VM29173
2026-03-28 12:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-28 12:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-28 12:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386 to the API
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:42:57Z',
 'fuel_type': 'petrol',
 'id': '584ceb9e-5605-5102-b1d0-e5ade31e20e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV01386',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 79518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.nl] INFO: Saving data for XV01386: {'auction_closing_time': 1774716177.0, 'created_time': 1773774209.302946, 'last_price_update_time': 1774699344.45337}
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV01386') HTTP/1.1" 204 0
2026-03-28 12:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-28 12:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-28 12:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173 to the API
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:30:25Z',
 'fuel_type': 'petrol',
 'id': 'f84e3317-ddd1-523b-9a75-a66dcc4b3359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM29173',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Atos',
 'odometer': 165517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-03',
 'seller_name': None,
 'title': 'Hyundai Atos 1.0 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2002}
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.nl] INFO: Saving data for VM29173: {'auction_closing_time': 1774715425.0, 'created_time': 1774612899.552988, 'last_price_update_time': 1774699344.761298}
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM29173') HTTP/1.1" 204 0
2026-03-28 12:02:24 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH84557%27 HTTP/1.1" 200 None
2026-03-28 12:02:24 [auto1.nl] INFO: Scrape type for DH84557: 2
2026-03-28 12:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557
2026-03-28 12:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with scrape type 2
2026-03-28 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with scrape type 2
2026-03-28 12:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ae2506ce-9cca-5295-a0b0-d9ad8efa4626, identifier: DH84557
2026-03-28 12:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557
2026-03-28 12:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557
2026-03-28 12:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557 to the API
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:09:26Z',
 'fuel_type': 'petrol',
 'id': 'ae2506ce-9cca-5295-a0b0-d9ad8efa4626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH84557',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 195422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH84557%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.nl] INFO: Saving data for DH84557: {'auction_closing_time': 1774714166.0, 'created_time': 1773132746.16432, 'last_price_update_time': 1774699345.219828}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DH84557') HTTP/1.1" 204 0
2026-03-28 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:25 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.nl] INFO: Scrape type for WS29354: 2
2026-03-28 12:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-28 12:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1fa8f90-f881-58b0-ab46-6f3480823f82 with scrape type 2
2026-03-28 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1fa8f90-f881-58b0-ab46-6f3480823f82 with scrape type 2
2026-03-28 12:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1fa8f90-f881-58b0-ab46-6f3480823f82, identifier: WS29354
2026-03-28 12:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-28 12:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-28 12:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354 to the API
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:30:58Z',
 'fuel_type': 'hybrid',
 'id': 'c1fa8f90-f881-58b0-ab46-6f3480823f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS29354',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 100541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Inscription Expression AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression AWD',
 'year': 2019}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.nl] INFO: Saving data for WS29354: {'auction_closing_time': 1774715458.0, 'created_time': 1773514874.68678, 'last_price_update_time': 1774699345.630755}
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS29354') HTTP/1.1" 204 0
2026-03-28 12:02:25 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-28 12:02:25 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 12:02:25 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS82995%27 HTTP/1.1" 200 None
2026-03-28 12:02:25 [auto1.nl] INFO: Scrape type for FS82995: 2
2026-03-28 12:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995
2026-03-28 12:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb32a20-1123-5517-88f8-6f90829852a0 with scrape type 2
2026-03-28 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eb32a20-1123-5517-88f8-6f90829852a0 with scrape type 2
2026-03-28 12:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4eb32a20-1123-5517-88f8-6f90829852a0, identifier: FS82995
2026-03-28 12:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995
2026-03-28 12:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995
2026-03-28 12:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995 to the API
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:26:27Z',
 'fuel_type': 'petrol',
 'id': '4eb32a20-1123-5517-88f8-6f90829852a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS82995',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 188888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS82995%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.nl] INFO: Saving data for FS82995: {'auction_closing_time': 1774715187.0, 'created_time': 1774267339.20437, 'last_price_update_time': 1774699346.089561}
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FS82995') HTTP/1.1" 204 0
2026-03-28 12:02:26 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.nl] INFO: Scrape type for HT40495: 2
2026-03-28 12:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-28 12:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da3445bc-a86e-5c98-bdcd-d53d95056772 with scrape type 2
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da3445bc-a86e-5c98-bdcd-d53d95056772 with scrape type 2
2026-03-28 12:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: da3445bc-a86e-5c98-bdcd-d53d95056772, identifier: HT40495
2026-03-28 12:02:26 [auto1.nl] INFO: Channel: 24h | Page: 26 | totalHits: 1045 | hits on page: 40
2026-03-28 12:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-28 12:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-28 12:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495 to the API
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:46Z',
 'fuel_type': 'petrol',
 'id': 'da3445bc-a86e-5c98-bdcd-d53d95056772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT40495',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 199743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.nl] INFO: Saving data for HT40495: {'auction_closing_time': 1774713766.0, 'created_time': 1773861110.385504, 'last_price_update_time': 1774699346.652047}
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT40495') HTTP/1.1" 204 0
2026-03-28 12:02:26 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.nl] INFO: Scrape type for WZ36257: 2
2026-03-28 12:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-28 12:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with scrape type 2
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with scrape type 2
2026-03-28 12:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28ba592c-7ac3-5729-9be0-10f3ce0989b3, identifier: WZ36257
2026-03-28 12:02:26 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-28 12:02:26 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-28 12:02:26 [auto1.nl] INFO: Scrape type for NF23683: 2
2026-03-28 12:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-28 12:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with scrape type 2
2026-03-28 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with scrape type 2
2026-03-28 12:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab, identifier: NF23683
2026-03-28 12:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-28 12:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-28 12:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257 to the API
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:24:32Z',
 'fuel_type': 'petrol',
 'id': '28ba592c-7ac3-5729-9be0-10f3ce0989b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ36257',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 259254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-28 12:02:27 [auto1.nl] INFO: Saving data for WZ36257: {'auction_closing_time': 1774715072.0, 'created_time': 1773133835.683907, 'last_price_update_time': 1774699347.205869}
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ36257') HTTP/1.1" 204 0
2026-03-28 12:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-28 12:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-28 12:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683 to the API
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:46Z',
 'fuel_type': 'petrol',
 'id': '5bc5c40f-a752-5a49-9269-c9cd8c7a0bab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF23683',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 71757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-10-07',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 1997}
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-28 12:02:27 [auto1.nl] INFO: Saving data for NF23683: {'auction_closing_time': 1774714786.0, 'created_time': 1774612913.286393, 'last_price_update_time': 1774699347.526137}
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF23683') HTTP/1.1" 204 0
2026-03-28 12:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:27 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-28 12:02:27 [auto1.nl] INFO: Scrape type for CY67010: 2
2026-03-28 12:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-28 12:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626b999f-1528-580b-b99b-228af78dc2b6 with scrape type 2
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626b999f-1528-580b-b99b-228af78dc2b6 with scrape type 2
2026-03-28 12:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 626b999f-1528-580b-b99b-228af78dc2b6, identifier: CY67010
2026-03-28 12:02:27 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-28 12:02:27 [auto1.nl] INFO: Scrape type for WH69219: 2
2026-03-28 12:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-28 12:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82f516b-5659-5a1c-8ac5-9da25e80afaa with scrape type 2
2026-03-28 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c82f516b-5659-5a1c-8ac5-9da25e80afaa with scrape type 2
2026-03-28 12:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c82f516b-5659-5a1c-8ac5-9da25e80afaa, identifier: WH69219
2026-03-28 12:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-28 12:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-28 12:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010 to the API
2026-03-28 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:06:57Z',
 'fuel_type': 'petrol',
 'id': '626b999f-1528-580b-b99b-228af78dc2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY67010',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 241219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-23',
 'seller_name': None,
 'title': 'Volvo V70 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2011}
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.nl] INFO: Saving data for CY67010: {'auction_closing_time': 1774714017.0, 'created_time': 1773687672.755652, 'last_price_update_time': 1774699348.353894}
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY67010') HTTP/1.1" 204 0
2026-03-28 12:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-28 12:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-28 12:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219 to the API
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:35:45Z',
 'fuel_type': 'hybrid',
 'id': 'c82f516b-5659-5a1c-8ac5-9da25e80afaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH69219',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 254498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.nl] INFO: Saving data for WH69219: {'auction_closing_time': 1774715745.0, 'created_time': 1774612920.729176, 'last_price_update_time': 1774699348.628839}
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WH69219') HTTP/1.1" 204 0
2026-03-28 12:02:28 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.nl] INFO: Scrape type for XJ71773: 2
2026-03-28 12:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-28 12:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587b4062-1786-5f79-aafa-869288bf6b45 with scrape type 2
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587b4062-1786-5f79-aafa-869288bf6b45 with scrape type 2
2026-03-28 12:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 587b4062-1786-5f79-aafa-869288bf6b45, identifier: XJ71773
2026-03-28 12:02:28 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 12:02:28 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 12:02:28 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-28 12:02:28 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 12:02:28 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-28 12:02:28 [auto1.nl] INFO: Scrape type for ZX63291: 2
2026-03-28 12:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-28 12:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b713f838-6685-5d90-b854-e23da1bc833d with scrape type 2
2026-03-28 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b713f838-6685-5d90-b854-e23da1bc833d with scrape type 2
2026-03-28 12:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b713f838-6685-5d90-b854-e23da1bc833d, identifier: ZX63291
2026-03-28 12:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-28 12:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-28 12:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773 to the API
2026-03-28 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:20:32Z',
 'fuel_type': 'petrol',
 'id': '587b4062-1786-5f79-aafa-869288bf6b45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ71773',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 87103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'BMW 4er 420i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.nl] INFO: Saving data for XJ71773: {'auction_closing_time': 1774714832.0, 'created_time': 1774267370.469334, 'last_price_update_time': 1774699349.154028}
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ71773') HTTP/1.1" 204 0
2026-03-28 12:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-28 12:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-28 12:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291 to the API
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:34:10Z',
 'fuel_type': 'petrol',
 'id': 'b713f838-6685-5d90-b854-e23da1bc833d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX63291',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 128430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 THP Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2017}
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.nl] INFO: Saving data for ZX63291: {'auction_closing_time': 1774715650.0, 'created_time': 1774612901.721575, 'last_price_update_time': 1774699349.547492}
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZX63291') HTTP/1.1" 204 0
2026-03-28 12:02:29 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.nl] INFO: Scrape type for CC90793: 2
2026-03-28 12:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-28 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c95ce620-8b77-59ba-8269-2f4c78b76f63 with scrape type 2
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c95ce620-8b77-59ba-8269-2f4c78b76f63 with scrape type 2
2026-03-28 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c95ce620-8b77-59ba-8269-2f4c78b76f63, identifier: CC90793
2026-03-28 12:02:29 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG94378%27 HTTP/1.1" 200 None
2026-03-28 12:02:29 [auto1.nl] INFO: Scrape type for BG94378: 2
2026-03-28 12:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378
2026-03-28 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with scrape type 2
2026-03-28 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with scrape type 2
2026-03-28 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee, identifier: BG94378
2026-03-28 12:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-28 12:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-28 12:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793 to the API
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:15:08Z',
 'fuel_type': 'petrol',
 'id': 'c95ce620-8b77-59ba-8269-2f4c78b76f63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC90793',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 204594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-02',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-28 12:02:30 [auto1.nl] INFO: Saving data for CC90793: {'auction_closing_time': 1774714508.0, 'created_time': 1774119698.454132, 'last_price_update_time': 1774699350.040638}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CC90793') HTTP/1.1" 204 0
2026-03-28 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378
2026-03-28 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378
2026-03-28 12:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378 to the API
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:31Z',
 'fuel_type': 'petrol',
 'id': '7c6fddb6-26c8-592e-a5bf-411dfbf85eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG94378',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 317241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-20',
 'seller_name': None,
 'title': 'Opel Insignia 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG94378%27 HTTP/1.1" 200 None
2026-03-28 12:02:30 [auto1.nl] INFO: Saving data for BG94378: {'auction_closing_time': 1774715491.0, 'created_time': 1774094465.091444, 'last_price_update_time': 1774699350.345627}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG94378') HTTP/1.1" 204 0
2026-03-28 12:02:30 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 12:02:30 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 12:02:30 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 12:02:30 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-28 12:02:30 [auto1.nl] INFO: Scrape type for FY76730: 2
2026-03-28 12:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-28 12:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with scrape type 2
2026-03-28 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with scrape type 2
2026-03-28 12:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 77c6191a-39c6-55cc-8e1b-5ef67fad3537, identifier: FY76730
2026-03-28 12:02:30 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 12:02:30 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-28 12:02:30 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ44063%27 HTTP/1.1" 200 None
2026-03-28 12:02:30 [auto1.nl] INFO: Scrape type for ZZ44063: 2
2026-03-28 12:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063
2026-03-28 12:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d93669-9311-5e31-a119-b799d480993c with scrape type 2
2026-03-28 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1d93669-9311-5e31-a119-b799d480993c with scrape type 2
2026-03-28 12:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d1d93669-9311-5e31-a119-b799d480993c, identifier: ZZ44063
2026-03-28 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-28 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-28 12:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730 to the API
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:08Z',
 'fuel_type': 'diesel',
 'id': '77c6191a-39c6-55cc-8e1b-5ef67fad3537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY76730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 249210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-28 12:02:30 [auto1.nl] INFO: Saving data for FY76730: {'auction_closing_time': 1774716608.0, 'created_time': 1773131923.538821, 'last_price_update_time': 1774699350.841874}
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FY76730') HTTP/1.1" 204 0
2026-03-28 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063
2026-03-28 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063
2026-03-28 12:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063 to the API
2026-03-28 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:29:57Z',
 'fuel_type': 'petrol',
 'id': 'd1d93669-9311-5e31-a119-b799d480993c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ44063',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 150822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2012}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ44063%27 HTTP/1.1" 200 None
2026-03-28 12:02:31 [auto1.nl] INFO: Saving data for ZZ44063: {'auction_closing_time': 1774715397.0, 'created_time': 1774612923.406041, 'last_price_update_time': 1774699351.400095}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ44063') HTTP/1.1" 204 0
2026-03-28 12:02:31 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 12:02:31 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 12:02:31 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-28 12:02:31 [auto1.nl] INFO: Scrape type for SL12489: 2
2026-03-28 12:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-28 12:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 089b05a9-5f33-5c13-ad69-689086c457da with scrape type 2
2026-03-28 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 089b05a9-5f33-5c13-ad69-689086c457da with scrape type 2
2026-03-28 12:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 089b05a9-5f33-5c13-ad69-689086c457da, identifier: SL12489
2026-03-28 12:02:31 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 12:02:31 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51310%27 HTTP/1.1" 200 None
2026-03-28 12:02:31 [auto1.nl] INFO: Scrape type for DK51310: 2
2026-03-28 12:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310
2026-03-28 12:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a7b7fb-5c83-58b3-9132-e13daed78825 with scrape type 2
2026-03-28 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a7b7fb-5c83-58b3-9132-e13daed78825 with scrape type 2
2026-03-28 12:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38a7b7fb-5c83-58b3-9132-e13daed78825, identifier: DK51310
2026-03-28 12:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-28 12:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-28 12:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489 to the API
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:09:34Z',
 'fuel_type': 'hybrid',
 'id': '089b05a9-5f33-5c13-ad69-689086c457da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL12489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 111869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-28 12:02:31 [auto1.nl] INFO: Saving data for SL12489: {'auction_closing_time': 1774714174.0, 'created_time': 1773688329.132838, 'last_price_update_time': 1774699351.912746}
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SL12489') HTTP/1.1" 204 0
2026-03-28 12:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310
2026-03-28 12:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310
2026-03-28 12:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310 to the API
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:23:24Z',
 'fuel_type': 'petrol',
 'id': '38a7b7fb-5c83-58b3-9132-e13daed78825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK51310',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 109984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Série Spéciale',
 'transmission': 'manual',
 'trim': 'Série Spéciale',
 'year': 2012}
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51310%27 HTTP/1.1" 200 None
2026-03-28 12:02:32 [auto1.nl] INFO: Saving data for DK51310: {'auction_closing_time': 1774715004.0, 'created_time': 1774612918.28487, 'last_price_update_time': 1774699352.296329}
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK51310') HTTP/1.1" 204 0
2026-03-28 12:02:32 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 12:02:32 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ95506%27 HTTP/1.1" 200 None
2026-03-28 12:02:32 [auto1.nl] INFO: Scrape type for LJ95506: 2
2026-03-28 12:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506
2026-03-28 12:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with scrape type 2
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with scrape type 2
2026-03-28 12:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3, identifier: LJ95506
2026-03-28 12:02:32 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 12:02:32 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 12:02:32 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-28 12:02:32 [auto1.nl] INFO: Scrape type for ZC66376: 2
2026-03-28 12:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-28 12:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e694759e-81bc-546a-b3b5-4a98c30a5836 with scrape type 2
2026-03-28 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e694759e-81bc-546a-b3b5-4a98c30a5836 with scrape type 2
2026-03-28 12:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e694759e-81bc-546a-b3b5-4a98c30a5836, identifier: ZC66376
2026-03-28 12:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506
2026-03-28 12:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506
2026-03-28 12:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506 to the API
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:28:51Z',
 'fuel_type': 'petrol',
 'id': '4da47a34-cfe8-5c2b-aa45-be8ec079c8b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ95506',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 246282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-28',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ95506%27 HTTP/1.1" 200 None
2026-03-28 12:02:32 [auto1.nl] INFO: Saving data for LJ95506: {'auction_closing_time': 1774715331.0, 'created_time': 1774094456.324889, 'last_price_update_time': 1774699352.872418}
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LJ95506') HTTP/1.1" 204 0
2026-03-28 12:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-28 12:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-28 12:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376 to the API
2026-03-28 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:38:17Z',
 'fuel_type': 'petrol',
 'id': 'e694759e-81bc-546a-b3b5-4a98c30a5836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC66376',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-28 12:02:33 [auto1.nl] INFO: Saving data for ZC66376: {'auction_closing_time': 1774715897.0, 'created_time': 1774612929.820288, 'last_price_update_time': 1774699353.141555}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZC66376') HTTP/1.1" 204 0
2026-03-28 12:02:33 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-28 12:02:33 [auto1.nl] INFO: Scrape type for CR43638: 2
2026-03-28 12:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-28 12:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa788e2c-e5db-583a-9086-06980bff4626 with scrape type 2
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa788e2c-e5db-583a-9086-06980bff4626 with scrape type 2
2026-03-28 12:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa788e2c-e5db-583a-9086-06980bff4626, identifier: CR43638
2026-03-28 12:02:33 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-28 12:02:33 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 12:02:33 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 12:02:33 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 12:02:33 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-28 12:02:33 [auto1.nl] INFO: Scrape type for TU10821: 2
2026-03-28 12:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-28 12:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with scrape type 2
2026-03-28 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with scrape type 2
2026-03-28 12:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5, identifier: TU10821
2026-03-28 12:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-28 12:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-28 12:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638 to the API
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:19:12Z',
 'fuel_type': 'petrol',
 'id': 'fa788e2c-e5db-583a-9086-06980bff4626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR43638',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 343820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-30',
 'seller_name': None,
 'title': 'Volvo XC70 2.5 T AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2004}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-28 12:02:33 [auto1.nl] INFO: Saving data for CR43638: {'auction_closing_time': 1774714752.0, 'created_time': 1773688140.77592, 'last_price_update_time': 1774699353.632186}
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR43638') HTTP/1.1" 204 0
2026-03-28 12:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-28 12:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-28 12:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821 to the API
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:28:30Z',
 'fuel_type': 'hybrid',
 'id': 'f612b92c-ca6f-5c6b-9312-41fbdee5d4a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU10821',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 156841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-28 12:02:34 [auto1.nl] INFO: Saving data for TU10821: {'auction_closing_time': 1774715310.0, 'created_time': 1774612922.618508, 'last_price_update_time': 1774699354.055365}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU10821') HTTP/1.1" 204 0
2026-03-28 12:02:34 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-28 12:02:34 [auto1.nl] INFO: Scrape type for ZD26534: 2
2026-03-28 12:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-28 12:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with scrape type 2
2026-03-28 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with scrape type 2
2026-03-28 12:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9, identifier: ZD26534
2026-03-28 12:02:34 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-28 12:02:34 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 12:02:34 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-28 12:02:34 [auto1.nl] INFO: Scrape type for ET49040: 2
2026-03-28 12:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-28 12:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with scrape type 2
2026-03-28 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with scrape type 2
2026-03-28 12:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14436c4b-d70a-5d2f-9e2b-e80701a321d1, identifier: ET49040
2026-03-28 12:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-28 12:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-28 12:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534 to the API
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-28T16:28:28Z',
 'fuel_type': 'petrol',
 'id': 'b55b8a52-4a17-50e8-bf86-3bbf8f9513e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD26534',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 88154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-03-31',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Privilege',
 'transmission': 'automatic',
 'trim': 'Privilege',
 'year': 2001}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-28 12:02:34 [auto1.nl] INFO: Saving data for ZD26534: {'auction_closing_time': 1774715308.0, 'created_time': 1774119703.372047, 'last_price_update_time': 1774699354.557617}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZD26534') HTTP/1.1" 204 0
2026-03-28 12:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-28 12:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-28 12:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040 to the API
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'diesel',
 'id': '14436c4b-d70a-5d2f-9e2b-e80701a321d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET49040',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 158951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-10',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-28 12:02:34 [auto1.nl] INFO: Saving data for ET49040: {'auction_closing_time': 1774716320.0, 'created_time': 1773921682.734775, 'last_price_update_time': 1774699354.882227}
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ET49040') HTTP/1.1" 204 0
2026-03-28 12:02:34 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 12:02:34 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-28 12:02:34 [auto1.nl] INFO: Scrape type for LZ16255: 2
2026-03-28 12:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-28 12:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40131f07-463d-5f7f-807e-464c2c26bec6 with scrape type 2
2026-03-28 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40131f07-463d-5f7f-807e-464c2c26bec6 with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40131f07-463d-5f7f-807e-464c2c26bec6, identifier: LZ16255
2026-03-28 12:02:35 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.nl] INFO: Scrape type for HX39878: 2
2026-03-28 12:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-28 12:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4, identifier: HX39878
2026-03-28 12:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-28 12:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-28 12:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255 to the API
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'diesel',
 'id': '40131f07-463d-5f7f-807e-464c2c26bec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ16255',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 176051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L2 Pack Clim NAV',
 'transmission': 'manual',
 'trim': 'L2 Pack Clim NAV',
 'year': 2016}
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.nl] INFO: Saving data for LZ16255: {'auction_closing_time': 1774716565.0, 'created_time': 1773134125.440572, 'last_price_update_time': 1774699355.372408}
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ16255') HTTP/1.1" 204 0
2026-03-28 12:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-28 12:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-28 12:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878 to the API
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:04:34Z',
 'fuel_type': 'diesel',
 'id': '3e56f71a-324e-5b5e-98ba-a45bc9312ca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX39878',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 302684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.nl] INFO: Saving data for HX39878: {'auction_closing_time': 1774713874.0, 'created_time': 1773301433.958018, 'last_price_update_time': 1774699355.654519}
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX39878') HTTP/1.1" 204 0
2026-03-28 12:02:35 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-28 12:02:35 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.nl] INFO: Scrape type for KV65945: 2
2026-03-28 12:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-28 12:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd, identifier: KV65945
2026-03-28 12:02:35 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 12:02:35 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 12:02:35 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-28 12:02:35 [auto1.nl] INFO: Scrape type for NH69771: 2
2026-03-28 12:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-28 12:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b945ca5-8729-5969-8084-dd3813847f20 with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b945ca5-8729-5969-8084-dd3813847f20 with scrape type 2
2026-03-28 12:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b945ca5-8729-5969-8084-dd3813847f20, identifier: NH69771
2026-03-28 12:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-28 12:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-28 12:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945 to the API
2026-03-28 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:58:53Z',
 'fuel_type': 'petrol',
 'id': '9ce57fc6-21cb-5cf4-9505-b43c50982bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV65945',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 241139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2018}
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.nl] INFO: Saving data for KV65945: {'auction_closing_time': 1774717133.0, 'created_time': 1773134595.059007, 'last_price_update_time': 1774699356.158323}
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV65945') HTTP/1.1" 204 0
2026-03-28 12:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-28 12:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-28 12:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771 to the API
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:18:27Z',
 'fuel_type': 'petrol',
 'id': '5b945ca5-8729-5969-8084-dd3813847f20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH69771',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.nl] INFO: Saving data for NH69771: {'auction_closing_time': 1774714707.0, 'created_time': 1774612904.604052, 'last_price_update_time': 1774699356.56899}
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NH69771') HTTP/1.1" 204 0
2026-03-28 12:02:36 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 12:02:36 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 12:02:36 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59485%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.nl] INFO: Scrape type for HH59485: 2
2026-03-28 12:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485
2026-03-28 12:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with scrape type 2
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with scrape type 2
2026-03-28 12:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d492c8e-59d2-5069-8895-1a95c64c6ce6, identifier: HH59485
2026-03-28 12:02:36 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 12:02:36 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 12:02:36 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-28 12:02:36 [auto1.nl] INFO: Scrape type for MT73533: 2
2026-03-28 12:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-28 12:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2256f2db-0947-57ef-94a0-278089f7b68f with scrape type 2
2026-03-28 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2256f2db-0947-57ef-94a0-278089f7b68f with scrape type 2
2026-03-28 12:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2256f2db-0947-57ef-94a0-278089f7b68f, identifier: MT73533
2026-03-28 12:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485
2026-03-28 12:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485
2026-03-28 12:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485 to the API
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:24:51Z',
 'fuel_type': 'hybrid',
 'id': '7d492c8e-59d2-5069-8895-1a95c64c6ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH59485',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 119721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four Pack Business',
 'transmission': 'automatic',
 'trim': 'E-Four Pack Business',
 'year': 2016}
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59485%27 HTTP/1.1" 200 None
2026-03-28 12:02:37 [auto1.nl] INFO: Saving data for HH59485: {'auction_closing_time': 1774715091.0, 'created_time': 1774292564.316202, 'last_price_update_time': 1774699357.103058}
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH59485') HTTP/1.1" 204 0
2026-03-28 12:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-28 12:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-28 12:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533 to the API
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:24:08Z',
 'fuel_type': 'diesel',
 'id': '2256f2db-0947-57ef-94a0-278089f7b68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT73533',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 113573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-11',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2010}
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-28 12:02:37 [auto1.nl] INFO: Saving data for MT73533: {'auction_closing_time': 1774715048.0, 'created_time': 1773923303.404222, 'last_price_update_time': 1774699357.395066}
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MT73533') HTTP/1.1" 204 0
2026-03-28 12:02:37 [auto1.nl] INFO: Channel: 24h | Page: 27 | totalHits: 1045 | hits on page: 5
2026-03-28 12:02:37 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 12:02:37 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-28 12:02:37 [auto1.nl] INFO: Scrape type for ZY76952: 2
2026-03-28 12:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-28 12:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with scrape type 2
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with scrape type 2
2026-03-28 12:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5fe40737-41f2-5ed0-b906-886d15eb0cb2, identifier: ZY76952
2026-03-28 12:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-28 12:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-28 12:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952 to the API
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:20:14Z',
 'fuel_type': 'petrol',
 'id': '5fe40737-41f2-5ed0-b906-886d15eb0cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY76952',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 143558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-28 12:02:37 [auto1.nl] INFO: Saving data for ZY76952: {'auction_closing_time': 1774714814.0, 'created_time': 1773302531.720045, 'last_price_update_time': 1774699357.807662}
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY76952') HTTP/1.1" 204 0
2026-03-28 12:02:37 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-28 12:02:37 [auto1.nl] INFO: Scrape type for NV42843: 2
2026-03-28 12:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-28 12:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14aed98b-74ab-5de5-987c-17d9cafc2f45 with scrape type 2
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14aed98b-74ab-5de5-987c-17d9cafc2f45 with scrape type 2
2026-03-28 12:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14aed98b-74ab-5de5-987c-17d9cafc2f45, identifier: NV42843
2026-03-28 12:02:37 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-28 12:02:37 [auto1.nl] INFO: Scrape type for BZ34461: 2
2026-03-28 12:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-28 12:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d52b8792-fb43-5a09-aad8-ec4816df7017 with scrape type 2
2026-03-28 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d52b8792-fb43-5a09-aad8-ec4816df7017 with scrape type 2
2026-03-28 12:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d52b8792-fb43-5a09-aad8-ec4816df7017, identifier: BZ34461
2026-03-28 12:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-28 12:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-28 12:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843 to the API
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:34:52Z',
 'fuel_type': 'petrol',
 'id': '14aed98b-74ab-5de5-987c-17d9cafc2f45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV42843',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 194299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.nl] INFO: Saving data for NV42843: {'auction_closing_time': 1774715692.0, 'created_time': 1773946977.983496, 'last_price_update_time': 1774699358.387505}
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV42843') HTTP/1.1" 204 0
2026-03-28 12:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-28 12:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-28 12:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461 to the API
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:43:14Z',
 'fuel_type': 'hybrid',
 'id': 'd52b8792-fb43-5a09-aad8-ec4816df7017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ34461',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 155516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.nl] INFO: Saving data for BZ34461: {'auction_closing_time': 1774716194.0, 'created_time': 1774612912.421671, 'last_price_update_time': 1774699358.696597}
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ34461') HTTP/1.1" 204 0
2026-03-28 12:02:38 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 12:02:38 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.nl] INFO: Scrape type for GK86118: 2
2026-03-28 12:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-28 12:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e57ec-1928-59dc-9d38-b84d16cd6859 with scrape type 2
2026-03-28 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23e57ec-1928-59dc-9d38-b84d16cd6859 with scrape type 2
2026-03-28 12:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f23e57ec-1928-59dc-9d38-b84d16cd6859, identifier: GK86118
2026-03-28 12:02:38 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 12:02:38 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-28 12:02:38 [auto1.nl] INFO: Scrape type for TY61758: 2
2026-03-28 12:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-28 12:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with scrape type 2
2026-03-28 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with scrape type 2
2026-03-28 12:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0aeef802-f18a-50ad-bb65-7b97acd5ae62, identifier: TY61758
2026-03-28 12:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-28 12:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-28 12:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118 to the API
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'petrol',
 'id': 'f23e57ec-1928-59dc-9d38-b84d16cd6859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK86118',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 62977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.nl] INFO: Saving data for GK86118: {'auction_closing_time': 1774714609.0, 'created_time': 1774612909.369529, 'last_price_update_time': 1774699359.233847}
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GK86118') HTTP/1.1" 204 0
2026-03-28 12:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-28 12:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-28 12:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758 to the API
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:27:49Z',
 'fuel_type': 'petrol',
 'id': '0aeef802-f18a-50ad-bb65-7b97acd5ae62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY61758',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 198388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-20',
 'seller_name': None,
 'title': 'Audi S6 5.2 V10 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.nl] INFO: Saving data for TY61758: {'auction_closing_time': 1774715269.0, 'created_time': 1774612910.645523, 'last_price_update_time': 1774699359.584964}
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TY61758') HTTP/1.1" 204 0
2026-03-28 12:02:39 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.nl] INFO: Scrape type for AG89497: 2
2026-03-28 12:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-28 12:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with scrape type 2
2026-03-28 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with scrape type 2
2026-03-28 12:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a7ec237-2a90-569e-8b1b-718a7386d8d4, identifier: AG89497
2026-03-28 12:02:39 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-28 12:02:39 [auto1.nl] INFO: Scrape type for ZK51232: 2
2026-03-28 12:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232
2026-03-28 12:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac708c77-429d-538f-b6b1-e288c0cdccb5 with scrape type 2
2026-03-28 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac708c77-429d-538f-b6b1-e288c0cdccb5 with scrape type 2
2026-03-28 12:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ac708c77-429d-538f-b6b1-e288c0cdccb5, identifier: ZK51232
2026-03-28 12:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-28 12:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-28 12:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497 to the API
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:14:39Z',
 'fuel_type': 'diesel',
 'id': '7a7ec237-2a90-569e-8b1b-718a7386d8d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG89497',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 342341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-23',
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-28 12:02:40 [auto1.nl] INFO: Saving data for AG89497: {'auction_closing_time': 1774714479.0, 'created_time': 1774612906.109168, 'last_price_update_time': 1774699360.072836}
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AG89497') HTTP/1.1" 204 0
2026-03-28 12:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232
2026-03-28 12:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232
2026-03-28 12:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232 to the API
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:55:12Z',
 'fuel_type': 'petrol',
 'id': 'ac708c77-429d-538f-b6b1-e288c0cdccb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51232',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 72544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2012}
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-28 12:02:40 [auto1.nl] INFO: Saving data for ZK51232: {'auction_closing_time': 1774716912.0, 'created_time': 1774612910.992465, 'last_price_update_time': 1774699360.358716}
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK51232') HTTP/1.1" 204 0
2026-03-28 12:02:40 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 12:02:40 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 12:02:40 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-28 12:02:40 [auto1.nl] INFO: Scrape type for ML03692: 2
2026-03-28 12:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-28 12:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57604818-8aff-580a-8450-8d0c5b6addd5 with scrape type 2
2026-03-28 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57604818-8aff-580a-8450-8d0c5b6addd5 with scrape type 2
2026-03-28 12:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 57604818-8aff-580a-8450-8d0c5b6addd5, identifier: ML03692
2026-03-28 12:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-28 12:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-28 12:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692 to the API
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:59:50Z',
 'fuel_type': 'petrol',
 'id': '57604818-8aff-580a-8450-8d0c5b6addd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML03692',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 153690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-24',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2006}
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-28 12:02:40 [auto1.nl] INFO: Saving data for ML03692: {'auction_closing_time': 1774717190.0, 'created_time': 1773343742.09665, 'last_price_update_time': 1774699360.746561}
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML03692') HTTP/1.1" 204 0
2026-03-28 12:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:02:41 [auto1.nl] INFO: Channel: 24h | Page: 28 | totalHits: 1045 | hits on page: 0
2026-03-28 12:02:41 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 12:02:41 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-28 12:02:41 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 2}
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774267361 HTTP/1.1" 200 None
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AR85055') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY15296') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BH06445') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY78777') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY89848') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB89526') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT78754') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EC44613') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EF01238') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB04619') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FF62519') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK19827') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GM68754') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GT72444') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW58352') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN66763') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX19183') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KY41956') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LC66252') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LJ29436') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LY00547') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME79677') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MG04453') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MG56619') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MN51913') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MU61846') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW60386') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF89493') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PR43628') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RV44939') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY80321') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RZ24490') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SB41881') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE16828') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SK70021') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SR81744') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SW17105') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF07146') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TG38127') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU17457') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='US84379') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UZ24790') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH78180') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VK82008') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV89778') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG42782') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XC43539') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XF10444') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XF31929') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YM92331') HTTP/1.1" 204 0
2026-03-28 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YX91791') HTTP/1.1" 204 0
2026-03-28 12:02:42 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (149 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-28T12_00_00.jl
2026-03-28 12:02:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 888925,
 'downloader/request_count': 533,
 'downloader/request_method_count/GET': 503,
 'downloader/request_method_count/POST': 30,
 'downloader/response_bytes': 218113550,
 'downloader/response_count': 533,
 'downloader/response_status_count/200': 533,
 'dupefilter/filtered': 14,
 'elapsed_time_seconds': 150.727008,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 12, 2, 42, 499916, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 149,
 'log_count/DEBUG': 5421,
 'log_count/INFO': 5770,
 'memusage/max': 200695808,
 'memusage/startup': 147968000,
 'photo_download_count': 391,
 'request_depth_max': 31,
 'response_received_count': 142,
 'scheduler/dequeued': 533,
 'scheduler/dequeued/memory': 533,
 'scheduler/enqueued': 533,
 'scheduler/enqueued/memory': 533,
 'scrape_type/batch_skipped': 544,
 'scrape_type/new': 55,
 'scrape_type/price_update': 94,
 'scrape_type/skipped': 378,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 142,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.927953186048142,
 'scrapy-zyte-api/mean_response_seconds': 2.9610063743115163,
 'scrapy-zyte-api/processed': 142,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 142,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 141,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 142,
 'scrapy-zyte-api/request_args/httpRequestBody': 30,
 'scrapy-zyte-api/request_args/httpRequestMethod': 30,
 'scrapy-zyte-api/request_args/httpResponseBody': 142,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 142,
 'scrapy-zyte-api/request_args/sessionContext': 142,
 'scrapy-zyte-api/request_args/url': 142,
 'scrapy-zyte-api/status_codes/200': 142,
 'scrapy-zyte-api/success': 142,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1085,
 'source/total_available': 1045,
 'start_time': datetime.datetime(2026, 3, 28, 12, 0, 11, 772908, tzinfo=datetime.timezone.utc)}
2026-03-28 12:02:42 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 12:02:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ff2d9c98a10>
2026-03-28 12:02:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ff2d9a0aa50>