2026-03-30 12:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 12:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 12:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-30 12:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-30 12:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 12:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 12:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 12:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 12:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: bdfd6136d0d6ae67
2026-03-30 12:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 12:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-30T12_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 12:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 12:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 12:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 12:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 12:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 12:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 12:10:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 12:10:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 12:10:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 12:10:07 [scrapy.core.engine] INFO: Spider opened
2026-03-30 12:10:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:10:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-03-30 12:10:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 12:10:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:10:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:11:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 12:12:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:12:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 12:12:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.275(s), this was the 1st time calling it.
2026-03-30 12:12:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.25498001557791 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:13:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 12:14:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:14:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 12:14:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.492(s), this was the 2nd time calling it.
2026-03-30 12:14:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.159707148658647 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 12:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:07 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 1 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:15:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 146MiB
2026-03-30 12:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 12:15:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:07 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 1 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:16:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 146MiB
2026-03-30 12:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 12:16:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 12:16:24 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 1028 | hits on page: 40
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: UR05111
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: NY22066
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: VK82008
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK82008%27 HTTP/1.1" 200 None
2026-03-30 12:16:24 [auto1.nl] INFO: Scrape type for VK82008: 1
2026-03-30 12:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: HR40942
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR40942%27 HTTP/1.1" 200 None
2026-03-30 12:16:24 [auto1.nl] INFO: Scrape type for HR40942: 1
2026-03-30 12:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: CM76870
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: UF27359
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: KB60202
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: GZ78686
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ78686%27 HTTP/1.1" 200 None
2026-03-30 12:16:24 [auto1.nl] INFO: Scrape type for GZ78686: 1
2026-03-30 12:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: UA26437
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: GY74168
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: XZ03488
2026-03-30 12:16:24 [auto1.nl] INFO: Found listing with ID: WN01271
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN01271%27 HTTP/1.1" 200 None
2026-03-30 12:16:24 [auto1.nl] INFO: Scrape type for WN01271: 2
2026-03-30 12:16:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32259825-12cc-587f-b825-92de9c4bf04a with identifier: WN01271
2026-03-30 12:16:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32259825-12cc-587f-b825-92de9c4bf04a with scrape type 2
2026-03-30 12:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32259825-12cc-587f-b825-92de9c4bf04a with scrape type 2
2026-03-30 12:16:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32259825-12cc-587f-b825-92de9c4bf04a, identifier: WN01271
2026-03-30 12:16:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32259825-12cc-587f-b825-92de9c4bf04a with identifier: WN01271
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 12:16:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 12:16:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32259825-12cc-587f-b825-92de9c4bf04a with identifier: WN01271
2026-03-30 12:16:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32259825-12cc-587f-b825-92de9c4bf04a with identifier: WN01271 to the API
2026-03-30 12:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:51:48Z',
 'fuel_type': 'diesel',
 'id': '32259825-12cc-587f-b825-92de9c4bf04a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN01271',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 136921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN01271%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Saving data for WN01271: {'auction_closing_time': 1774972308.0, 'created_time': 1773231471.264995, 'last_price_update_time': 1774872985.169469}
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN01271') HTTP/1.1" 204 0
2026-03-30 12:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: PC48773
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC48773%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for PC48773: 1
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: JX93234
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: EF01238
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF01238%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for EF01238: 1
2026-03-30 12:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: KH11500
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: LY17744
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: DF70778
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: SE53451
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: SV08873
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV08873%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for SV08873: 1
2026-03-30 12:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: XF31929
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF31929%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for XF31929: 1
2026-03-30 12:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: GU59213
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: VR53235
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: KY22626
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KY22626%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for KY22626: 1
2026-03-30 12:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: KC57622
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: NJ54414
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ54414%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for NJ54414: 1
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: ZH86542
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZH86542%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for ZH86542: 1
2026-03-30 12:16:25 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-30 12:16:25 [auto1.nl] INFO: Scrape type for EW85240: 2
2026-03-30 12:16:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240
2026-03-30 12:16:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with scrape type 2
2026-03-30 12:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with scrape type 2
2026-03-30 12:16:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab, identifier: EW85240
2026-03-30 12:16:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 12:16:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 12:16:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240
2026-03-30 12:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5f8a5375-abfa-5bf9-8d89-4186d7b8afab with identifier: EW85240 to the API
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:11:29Z',
 'fuel_type': 'petrol',
 'id': '5f8a5375-abfa-5bf9-8d89-4186d7b8afab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW85240',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Pack',
 'transmission': 'manual',
 'trim': 'GT Pack',
 'year': 2021}
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-30 12:16:26 [auto1.nl] INFO: Saving data for EW85240: {'auction_closing_time': 1774969889.0, 'created_time': 1773232182.389484, 'last_price_update_time': 1774872986.234333}
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW85240') HTTP/1.1" 204 0
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: DL70871
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL70871%27 HTTP/1.1" 200 None
2026-03-30 12:16:26 [auto1.nl] INFO: Scrape type for DL70871: 1
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: MA87282
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: UP76924
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP76924%27 HTTP/1.1" 200 None
2026-03-30 12:16:26 [auto1.nl] INFO: Scrape type for UP76924: 1
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-30 12:16:26 [auto1.nl] INFO: Scrape type for SV01425: 2
2026-03-30 12:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425
2026-03-30 12:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69f4830-c1b4-5a02-8906-622cadf115a5 with scrape type 2
2026-03-30 12:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f69f4830-c1b4-5a02-8906-622cadf115a5 with scrape type 2
2026-03-30 12:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f69f4830-c1b4-5a02-8906-622cadf115a5, identifier: SV01425
2026-03-30 12:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425
2026-03-30 12:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425
2026-03-30 12:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425 to the API
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:29:53Z',
 'fuel_type': 'petrol',
 'id': 'f69f4830-c1b4-5a02-8906-622cadf115a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV01425',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 94002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-30 12:16:26 [auto1.nl] INFO: Saving data for SV01425: {'auction_closing_time': 1774970993.0, 'created_time': 1774527053.631373, 'last_price_update_time': 1774872986.858587}
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV01425') HTTP/1.1" 204 0
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: YB78167
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: PH19837
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: VW25358
2026-03-30 12:16:26 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-30 12:16:26 [auto1.nl] INFO: Scrape type for RX16781: 2
2026-03-30 12:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781
2026-03-30 12:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e92ea2-7200-5ede-b54a-85069c359e80 with scrape type 2
2026-03-30 12:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e92ea2-7200-5ede-b54a-85069c359e80 with scrape type 2
2026-03-30 12:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99e92ea2-7200-5ede-b54a-85069c359e80, identifier: RX16781
2026-03-30 12:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781
2026-03-30 12:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 12:16:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 12:16:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781
2026-03-30 12:16:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781 to the API
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-31T15:14:49Z',
 'fuel_type': 'hybrid',
 'id': '99e92ea2-7200-5ede-b54a-85069c359e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX16781',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 176833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2018}
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-30 12:16:27 [auto1.nl] INFO: Saving data for RX16781: {'auction_closing_time': 1774970089.0, 'created_time': 1774552340.591239, 'last_price_update_time': 1774872987.660915}
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RX16781') HTTP/1.1" 204 0
2026-03-30 12:16:27 [auto1.nl] INFO: Found listing with ID: PE66202
2026-03-30 12:16:27 [auto1.nl] INFO: Found listing with ID: WB81216
2026-03-30 12:16:27 [auto1.nl] INFO: Found listing with ID: ER66811
2026-03-30 12:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ78686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:28 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 1028 | hits on page: 40
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: UR05111
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: NY22066
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: VK82008
2026-03-30 12:16:28 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/VK82008/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: HR40942
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: CM76870
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: UF27359
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: KB60202
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: GZ78686
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: UA26437
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: GY74168
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: XZ03488
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: WN01271
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN01271%27 HTTP/1.1" 200 None
2026-03-30 12:16:28 [auto1.nl] INFO: Scrape type for WN01271: 0
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: PC48773
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: JX93234
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: EF01238
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: KH11500
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: LY17744
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: DF70778
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: SE53451
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: SV08873
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: XF31929
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: GU59213
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: VR53235
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: KY22626
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: KC57622
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: NJ54414
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: ZH86542
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-30 12:16:28 [auto1.nl] INFO: Scrape type for EW85240: 0
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: DL70871
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: MA87282
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: UP76924
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-30 12:16:28 [auto1.nl] INFO: Scrape type for SV01425: 0
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: YB78167
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: PH19837
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: VW25358
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-30 12:16:28 [auto1.nl] INFO: Scrape type for RX16781: 0
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: PE66202
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: WB81216
2026-03-30 12:16:28 [auto1.nl] INFO: Found listing with ID: ER66811
2026-03-30 12:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF01238/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH86542/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR40942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP76924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY22626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL70871/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ78686> (referer: https://www.auto1.com/v1/car-details-view/GZ78686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d03682-6f13-50ad-8205-189757bfe10c with identifier: GZ78686
2026-03-30 12:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d03682-6f13-50ad-8205-189757bfe10c with scrape type 1
2026-03-30 12:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 54d03682-6f13-50ad-8205-189757bfe10c
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_61627546080ae4330f020336014b4d87.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_61627546080ae4330f020336014b4d87.jpg not downloaded yet
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_6f4a930996564fb038e859465a842086.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_6f4a930996564fb038e859465a842086.jpg not downloaded yet
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_86954636f75d5b319e2cb6a720496337.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_86954636f75d5b319e2cb6a720496337.jpg not downloaded yet
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_0ca68c2520f2fde8b7e86bd83b5d0a64.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_0ca68c2520f2fde8b7e86bd83b5d0a64.jpg not downloaded yet
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_02c360fb131f89ecd505f6973d2c9749.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_02c360fb131f89ecd505f6973d2c9749.jpg not downloaded yet
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC48773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK82008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_61627546080ae4330f020336014b4d87.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_6f4a930996564fb038e859465a842086.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_86954636f75d5b319e2cb6a720496337.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69fafd0>
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_61627546080ae4330f020336014b4d87.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_61627546080ae4330f020336014b4d87.jpg saved to cache
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54d03682-6f13-50ad-8205-189757bfe10c
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_02c360fb131f89ecd505f6973d2c9749.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d601ad90>
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_6f4a930996564fb038e859465a842086.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_6f4a930996564fb038e859465a842086.jpg saved to cache
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54d03682-6f13-50ad-8205-189757bfe10c
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_0ca68c2520f2fde8b7e86bd83b5d0a64.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dd114610>
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_86954636f75d5b319e2cb6a720496337.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_86954636f75d5b319e2cb6a720496337.jpg saved to cache
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54d03682-6f13-50ad-8205-189757bfe10c
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d690fb50>
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_02c360fb131f89ecd505f6973d2c9749.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_02c360fb131f89ecd505f6973d2c9749.jpg saved to cache
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54d03682-6f13-50ad-8205-189757bfe10c
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d695b9d0>
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F15%252F40154746a624c00ac7668b70ad4385bf%252Fpa%252FGZ78686_0ca68c2520f2fde8b7e86bd83b5d0a64.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_0ca68c2520f2fde8b7e86bd83b5d0a64.jpg saved to cache
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54d03682-6f13-50ad-8205-189757bfe10c
2026-03-30 12:16:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54d03682-6f13-50ad-8205-189757bfe10c, skipping ID generation
2026-03-30 12:16:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d03682-6f13-50ad-8205-189757bfe10c with scrape type 1
2026-03-30 12:16:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54d03682-6f13-50ad-8205-189757bfe10c sending to next pipeline
2026-03-30 12:16:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 54d03682-6f13-50ad-8205-189757bfe10c, identifier: GZ78686
2026-03-30 12:16:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 54d03682-6f13-50ad-8205-189757bfe10c with identifier: GZ78686
2026-03-30 12:16:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 54d03682-6f13-50ad-8205-189757bfe10c with identifier: GZ78686
2026-03-30 12:16:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 54d03682-6f13-50ad-8205-189757bfe10c with identifier: GZ78686 to the API
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_0ca68c2520f2fde8b7e86bd83b5d0a64.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:11:15Z',
 'fuel_type': 'petrol',
 'id': '54d03682-6f13-50ad-8205-189757bfe10c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '56-RJB-3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ78686',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 87188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_61627546080ae4330f020336014b4d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_6f4a930996564fb038e859465a842086.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_86954636f75d5b319e2cb6a720496337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_0ca68c2520f2fde8b7e86bd83b5d0a64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d03682-6f13-50ad-8205-189757bfe10c/54d03682-6f13-50ad-8205-189757bfe10c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/15/40154746a624c00ac7668b70ad4385bf/pa/GZ78686_02c360fb131f89ecd505f6973d2c9749.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2011}
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ78686%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Saving data for GZ78686: {'created_time': 1774872994.414772, 'last_price_update_time': 1774872994.414783, 'auction_closing_time': 1774969875.0}
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GZ78686') HTTP/1.1" 204 0
2026-03-30 12:16:34 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 1028 | hits on page: 40
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: UY46153
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: XN23196
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: NY67233
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: VL04005
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: GV35300
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: WX35760
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX35760%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for WX35760: 1
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: DR68176
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: VA44599
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: LT18437
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT18437%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for LT18437: 1
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: GG31477
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG31477%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for GG31477: 1
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: KC94217
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC94217%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for KC94217: 1
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: AL09883
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: KY41956
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KY41956%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for KY41956: 1
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: LG57032
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57032%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for LG57032: 1
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: EY89733
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: BZ50743
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ50743%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for BZ50743: 1
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: VN23813
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: BJ30921
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: NA44396
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: MV83370
2026-03-30 12:16:34 [auto1.nl] INFO: Found listing with ID: EB77736
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB77736%27 HTTP/1.1" 200 None
2026-03-30 12:16:34 [auto1.nl] INFO: Scrape type for EB77736: 2
2026-03-30 12:16:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef6b9b51-8402-5431-aa01-2e8baf6c6e89 with identifier: EB77736
2026-03-30 12:16:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6b9b51-8402-5431-aa01-2e8baf6c6e89 with scrape type 2
2026-03-30 12:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef6b9b51-8402-5431-aa01-2e8baf6c6e89 with scrape type 2
2026-03-30 12:16:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ef6b9b51-8402-5431-aa01-2e8baf6c6e89, identifier: EB77736
2026-03-30 12:16:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ef6b9b51-8402-5431-aa01-2e8baf6c6e89 with identifier: EB77736
2026-03-30 12:16:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ef6b9b51-8402-5431-aa01-2e8baf6c6e89 with identifier: EB77736
2026-03-30 12:16:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ef6b9b51-8402-5431-aa01-2e8baf6c6e89 with identifier: EB77736 to the API
2026-03-30 12:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:17:40Z',
 'fuel_type': 'petrol',
 'id': 'ef6b9b51-8402-5431-aa01-2e8baf6c6e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB77736',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 45204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2022}
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB77736%27 HTTP/1.1" 200 None
2026-03-30 12:16:35 [auto1.nl] INFO: Saving data for EB77736: {'auction_closing_time': 1774970260.0, 'created_time': 1774120269.135862, 'last_price_update_time': 1774872995.151096}
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB77736') HTTP/1.1" 204 0
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: KG57573
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: UN65044
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UN65044%27 HTTP/1.1" 200 None
2026-03-30 12:16:35 [auto1.nl] INFO: Scrape type for UN65044: 1
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: BV79930
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: JK44728
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: NL07359
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: NC11102
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: GZ47828
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-30 12:16:35 [auto1.nl] INFO: Scrape type for KT18322: 2
2026-03-30 12:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322
2026-03-30 12:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62abd7e9-be11-51ec-ae7c-f87f0413f91a with scrape type 2
2026-03-30 12:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62abd7e9-be11-51ec-ae7c-f87f0413f91a with scrape type 2
2026-03-30 12:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 62abd7e9-be11-51ec-ae7c-f87f0413f91a, identifier: KT18322
2026-03-30 12:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 12:16:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322
2026-03-30 12:16:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322 to the API
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-31T15:29:50Z',
 'fuel_type': 'electro',
 'id': '62abd7e9-be11-51ec-ae7c-f87f0413f91a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT18322',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'EQC',
 'odometer': 130613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Mercedes-Benz EQC electric drive 300 kW 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-30 12:16:35 [auto1.nl] INFO: Saving data for KT18322: {'auction_closing_time': 1774970990.0, 'created_time': 1773688524.039443, 'last_price_update_time': 1774872995.946696}
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KT18322') HTTP/1.1" 204 0
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: KF66593
2026-03-30 12:16:35 [auto1.nl] INFO: Found listing with ID: XD28963
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD28963%27 HTTP/1.1" 200 None
2026-03-30 12:16:35 [auto1.nl] INFO: Scrape type for XD28963: 2
2026-03-30 12:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737138c5-d6ce-5cf2-92b3-9ddd6e669e1e with identifier: XD28963
2026-03-30 12:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737138c5-d6ce-5cf2-92b3-9ddd6e669e1e with scrape type 2
2026-03-30 12:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 737138c5-d6ce-5cf2-92b3-9ddd6e669e1e with scrape type 2
2026-03-30 12:16:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 737138c5-d6ce-5cf2-92b3-9ddd6e669e1e, identifier: XD28963
2026-03-30 12:16:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 737138c5-d6ce-5cf2-92b3-9ddd6e669e1e with identifier: XD28963
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 737138c5-d6ce-5cf2-92b3-9ddd6e669e1e with identifier: XD28963
2026-03-30 12:16:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 737138c5-d6ce-5cf2-92b3-9ddd6e669e1e with identifier: XD28963 to the API
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 86,
 'expiration_date': '2026-03-31T15:35:45Z',
 'fuel_type': 'petrol',
 'id': '737138c5-d6ce-5cf2-92b3-9ddd6e669e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD28963',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 57630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'Fiat 500 0.9 120th',
 'transmission': 'manual',
 'trim': '120th',
 'year': 2019}
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD28963%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [auto1.nl] INFO: Saving data for XD28963: {'auction_closing_time': 1774971345.0, 'created_time': 1774268075.586647, 'last_price_update_time': 1774872996.515252}
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD28963') HTTP/1.1" 204 0
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: FH41507
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: MS88690
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MS88690%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [auto1.nl] INFO: Scrape type for MS88690: 1
2026-03-30 12:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP76924> (referer: https://www.auto1.com/v1/car-details-view/UP76924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: BN42241
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN42241%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [auto1.nl] INFO: Scrape type for BN42241: 1
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: NF89493
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF89493%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [auto1.nl] INFO: Scrape type for NF89493: 1
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: ZS41016
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS41016%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [auto1.nl] INFO: Scrape type for ZS41016: 1
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: GE84449
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: CF89454
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: NU12312
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU12312%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [auto1.nl] INFO: Scrape type for NU12312: 1
2026-03-30 12:16:36 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-30 12:16:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1676f234-6fa2-5eda-b7d0-e2804d9cb08e with identifier: UP76924
2026-03-30 12:16:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1676f234-6fa2-5eda-b7d0-e2804d9cb08e with scrape type 1
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1676f234-6fa2-5eda-b7d0-e2804d9cb08e
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_046fcb87c5099b090ee565612c6ffb01.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_046fcb87c5099b090ee565612c6ffb01.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_48bc17d558ab54aa4c76db538f739e4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_48bc17d558ab54aa4c76db538f739e4c.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_364b44f34111fcf2ec563808bc42acfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_364b44f34111fcf2ec563808bc42acfb.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_8718f9ba122e7884ce7da48c8c4ac707.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_8718f9ba122e7884ce7da48c8c4ac707.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_1791d91532606fd5b6424c6ae7a022d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_1791d91532606fd5b6424c6ae7a022d5.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_8b2c233ca6527e0b90791a5570901f9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_8b2c233ca6527e0b90791a5570901f9b.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_bd8669c92d8accec02b599376dc6d412.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_bd8669c92d8accec02b599376dc6d412.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_0f09fb221a7dce3957f58d2494a10544.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_0f09fb221a7dce3957f58d2494a10544.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_cf326392734d21e2096af403af00170d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_cf326392734d21e2096af403af00170d.jpg already downloaded
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F61%252Fe2611d3964909a5ebfc1390a0034bd32%252Fpa%252FUP76924_92a4a73a4a8369b5277f5c81bdcd473c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_92a4a73a4a8369b5277f5c81bdcd473c.jpg already downloaded
2026-03-30 12:16:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1676f234-6fa2-5eda-b7d0-e2804d9cb08e, identifier: UP76924
2026-03-30 12:16:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1676f234-6fa2-5eda-b7d0-e2804d9cb08e with identifier: UP76924
2026-03-30 12:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:16:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1676f234-6fa2-5eda-b7d0-e2804d9cb08e with identifier: UP76924
2026-03-30 12:16:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1676f234-6fa2-5eda-b7d0-e2804d9cb08e with identifier: UP76924 to the API
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UP76924>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:18:11Z',
 'fuel_type': 'petrol',
 'id': '1676f234-6fa2-5eda-b7d0-e2804d9cb08e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP798N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP76924',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 110442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 26,
 'photo_urls': ['https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_046fcb87c5099b090ee565612c6ffb01.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_48bc17d558ab54aa4c76db538f739e4c.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_364b44f34111fcf2ec563808bc42acfb.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_8718f9ba122e7884ce7da48c8c4ac707.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_1791d91532606fd5b6424c6ae7a022d5.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_8b2c233ca6527e0b90791a5570901f9b.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_bd8669c92d8accec02b599376dc6d412.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_0f09fb221a7dce3957f58d2494a10544.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_cf326392734d21e2096af403af00170d.jpg',
                'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_92a4a73a4a8369b5277f5c81bdcd473c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_046fcb87c5099b090ee565612c6ffb01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_48bc17d558ab54aa4c76db538f739e4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_364b44f34111fcf2ec563808bc42acfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_8718f9ba122e7884ce7da48c8c4ac707.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_1791d91532606fd5b6424c6ae7a022d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_8b2c233ca6527e0b90791a5570901f9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_bd8669c92d8accec02b599376dc6d412.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_0f09fb221a7dce3957f58d2494a10544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_cf326392734d21e2096af403af00170d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1676f234-6fa2-5eda-b7d0-e2804d9cb08e/1676f234-6fa2-5eda-b7d0-e2804d9cb08e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/61/e2611d3964909a5ebfc1390a0034bd32/pa/UP76924_92a4a73a4a8369b5277f5c81bdcd473c.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2016}
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP76924%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [auto1.nl] INFO: Saving data for UP76924: {'created_time': 1774872997.503908, 'last_price_update_time': 1774872997.50392, 'auction_closing_time': 1774970291.0}
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UP76924') HTTP/1.1" 204 0
2026-03-30 12:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY22626> (referer: https://www.auto1.com/v1/car-details-view/KY22626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343411a0-6487-5c9f-beb2-c700a857ac42 with identifier: KY22626
2026-03-30 12:16:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343411a0-6487-5c9f-beb2-c700a857ac42 with scrape type 1
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 343411a0-6487-5c9f-beb2-c700a857ac42
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_631f7c156fce17f176f093bf1ec0751d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_631f7c156fce17f176f093bf1ec0751d.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_bd737098da79eb946910771d857d3a25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_bd737098da79eb946910771d857d3a25.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_19c7841a7695da0598144c58045b54e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_19c7841a7695da0598144c58045b54e1.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_4eae1a2cc02c1622cfb327d8156cf3c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_4eae1a2cc02c1622cfb327d8156cf3c4.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_bc1bd0c0f0c0c8946b9f07318b17dc9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_bc1bd0c0f0c0c8946b9f07318b17dc9f.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_8a07a3f5628737cb563ee192ef507a66.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_8a07a3f5628737cb563ee192ef507a66.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_504169a072266035b4ab210e1b40d95b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_504169a072266035b4ab210e1b40d95b.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_32309f2f1746988b28cfad1d0ef0509c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_32309f2f1746988b28cfad1d0ef0509c.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_24ac84e81255f4274eaa8e723ca23a2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_24ac84e81255f4274eaa8e723ca23a2b.jpg already downloaded
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fcd%252Fd6cd7eae8d8bd09b35fe0cd8ebb8f034%252Fpa%252FKY22626_979a59810bb359a080b39cabcd34c66b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_979a59810bb359a080b39cabcd34c66b.jpg already downloaded
2026-03-30 12:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 343411a0-6487-5c9f-beb2-c700a857ac42, identifier: KY22626
2026-03-30 12:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 343411a0-6487-5c9f-beb2-c700a857ac42 with identifier: KY22626
2026-03-30 12:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 343411a0-6487-5c9f-beb2-c700a857ac42 with identifier: KY22626
2026-03-30 12:16:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 343411a0-6487-5c9f-beb2-c700a857ac42 with identifier: KY22626 to the API
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY22626>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:19:40Z',
 'fuel_type': 'petrol',
 'id': '343411a0-6487-5c9f-beb2-c700a857ac42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '8KFS56',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY22626',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 202015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_631f7c156fce17f176f093bf1ec0751d.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_bd737098da79eb946910771d857d3a25.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_19c7841a7695da0598144c58045b54e1.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_4eae1a2cc02c1622cfb327d8156cf3c4.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_bc1bd0c0f0c0c8946b9f07318b17dc9f.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_8a07a3f5628737cb563ee192ef507a66.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_504169a072266035b4ab210e1b40d95b.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_32309f2f1746988b28cfad1d0ef0509c.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_24ac84e81255f4274eaa8e723ca23a2b.jpg',
                'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_979a59810bb359a080b39cabcd34c66b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2747054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_631f7c156fce17f176f093bf1ec0751d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_bd737098da79eb946910771d857d3a25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_19c7841a7695da0598144c58045b54e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468954,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_4eae1a2cc02c1622cfb327d8156cf3c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_bc1bd0c0f0c0c8946b9f07318b17dc9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2458582,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_8a07a3f5628737cb563ee192ef507a66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2294737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_504169a072266035b4ab210e1b40d95b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_32309f2f1746988b28cfad1d0ef0509c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_24ac84e81255f4274eaa8e723ca23a2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343411a0-6487-5c9f-beb2-c700a857ac42/343411a0-6487-5c9f-beb2-c700a857ac42_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/cd/d6cd7eae8d8bd09b35fe0cd8ebb8f034/pa/KY22626_979a59810bb359a080b39cabcd34c66b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KY22626%27 HTTP/1.1" 200 None
2026-03-30 12:16:38 [auto1.nl] INFO: Saving data for KY22626: {'created_time': 1774872998.414021, 'last_price_update_time': 1774872998.414031, 'auction_closing_time': 1774970380.0}
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KY22626') HTTP/1.1" 204 0
2026-03-30 12:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC48773> (referer: https://www.auto1.com/v1/car-details-view/PC48773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07142ec8-160c-5cc6-8985-5e335a12467d with identifier: PC48773
2026-03-30 12:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07142ec8-160c-5cc6-8985-5e335a12467d with scrape type 1
2026-03-30 12:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_ed60c4b6407a078b0cf8994e37b0314f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_ed60c4b6407a078b0cf8994e37b0314f.jpg not downloaded yet
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_a9336838c32a63f1d01e81519090dfd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_a9336838c32a63f1d01e81519090dfd0.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_0955a85fbd1ffd443d051d1fe2911479.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_0955a85fbd1ffd443d051d1fe2911479.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_b5f8dcf06589eb503c6c7742ad738636.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_b5f8dcf06589eb503c6c7742ad738636.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_f1f68e42a8d7b3387f529cdd62674eb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_f1f68e42a8d7b3387f529cdd62674eb8.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_9d2754a49b0d9b2197729065eb449ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_9d2754a49b0d9b2197729065eb449ec7.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_55a5ddaa2e4d965a607a3ba388c24e2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_55a5ddaa2e4d965a607a3ba388c24e2a.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_52cfb1fbd9719896f72096c42d677ead.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_52cfb1fbd9719896f72096c42d677ead.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_2d667d2393bdbaca43237fc59c9389ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_2d667d2393bdbaca43237fc59c9389ae.jpg not downloaded yet
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_32296e07ad31f9f7897a2f4648830bbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_32296e07ad31f9f7897a2f4648830bbe.jpg not downloaded yet
2026-03-30 12:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR40942> (referer: https://www.auto1.com/v1/car-details-view/HR40942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_32296e07ad31f9f7897a2f4648830bbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a with identifier: HR40942
2026-03-30 12:16:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a with scrape type 1
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_cc112cf361d54cb374036bf02bf33fca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_cc112cf361d54cb374036bf02bf33fca.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_2cd239a3f213ffd7bcd1cc78504b5739.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_2cd239a3f213ffd7bcd1cc78504b5739.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_79a72aa8b1578e2f2b11380fbf47579b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_79a72aa8b1578e2f2b11380fbf47579b.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_53bdfb4ff404d99c590308d412533610.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_53bdfb4ff404d99c590308d412533610.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_00371b7f60c0e050c5d143fe7284ad1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_00371b7f60c0e050c5d143fe7284ad1b.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_fd939c356bd05946704e3e4abc25a13d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_fd939c356bd05946704e3e4abc25a13d.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_7da511ca8a0753b21fae81fa4d6d1da3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_7da511ca8a0753b21fae81fa4d6d1da3.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_4b6ef74eaf5413ae24235db038099e19.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_4b6ef74eaf5413ae24235db038099e19.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_97359028b8d6785cbc85571d50e9712c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_97359028b8d6785cbc85571d50e9712c.jpg already downloaded
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F64%252F6164292128954171cb37c17eafad3003%252Fpa%252FHR40942_3935169c53c839002951e75d37380c87.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_3935169c53c839002951e75d37380c87.jpg already downloaded
2026-03-30 12:16:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a, identifier: HR40942
2026-03-30 12:16:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a with identifier: HR40942
2026-03-30 12:16:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a with identifier: HR40942
2026-03-30 12:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a with identifier: HR40942 to the API
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HR40942>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:40:25Z',
 'fuel_type': 'petrol',
 'id': 'a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZV288B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR40942',
 'listing': 'auction',
 'location': "NL, 's-Gravenzande",
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 46768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_cc112cf361d54cb374036bf02bf33fca.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_2cd239a3f213ffd7bcd1cc78504b5739.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_79a72aa8b1578e2f2b11380fbf47579b.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_53bdfb4ff404d99c590308d412533610.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_00371b7f60c0e050c5d143fe7284ad1b.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_fd939c356bd05946704e3e4abc25a13d.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_7da511ca8a0753b21fae81fa4d6d1da3.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_4b6ef74eaf5413ae24235db038099e19.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_97359028b8d6785cbc85571d50e9712c.jpg',
                'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_3935169c53c839002951e75d37380c87.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_cc112cf361d54cb374036bf02bf33fca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_2cd239a3f213ffd7bcd1cc78504b5739.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_79a72aa8b1578e2f2b11380fbf47579b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_53bdfb4ff404d99c590308d412533610.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_00371b7f60c0e050c5d143fe7284ad1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_fd939c356bd05946704e3e4abc25a13d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2651210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_7da511ca8a0753b21fae81fa4d6d1da3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_4b6ef74eaf5413ae24235db038099e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_97359028b8d6785cbc85571d50e9712c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a/a8c5bc59-9f1e-5d53-90c1-3f5e3955ff1a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/64/6164292128954171cb37c17eafad3003/pa/HR40942_3935169c53c839002951e75d37380c87.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR40942%27 HTTP/1.1" 200 None
2026-03-30 12:16:42 [auto1.nl] INFO: Saving data for HR40942: {'created_time': 1774873002.304153, 'last_price_update_time': 1774873002.304164, 'auction_closing_time': 1774971625.0}
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HR40942') HTTP/1.1" 204 0
2026-03-30 12:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_2d667d2393bdbaca43237fc59c9389ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ad3050>
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_32296e07ad31f9f7897a2f4648830bbe.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_32296e07ad31f9f7897a2f4648830bbe.jpg saved to cache
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6020390>
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_2d667d2393bdbaca43237fc59c9389ae.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_2d667d2393bdbaca43237fc59c9389ae.jpg saved to cache
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_52cfb1fbd9719896f72096c42d677ead.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d607ae50>
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_52cfb1fbd9719896f72096c42d677ead.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_52cfb1fbd9719896f72096c42d677ead.jpg saved to cache
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_55a5ddaa2e4d965a607a3ba388c24e2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6020d10>
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_55a5ddaa2e4d965a607a3ba388c24e2a.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_55a5ddaa2e4d965a607a3ba388c24e2a.jpg saved to cache
2026-03-30 12:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_9d2754a49b0d9b2197729065eb449ec7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_f1f68e42a8d7b3387f529cdd62674eb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d607a590>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_9d2754a49b0d9b2197729065eb449ec7.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_9d2754a49b0d9b2197729065eb449ec7.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_b5f8dcf06589eb503c6c7742ad738636.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6980c50>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_f1f68e42a8d7b3387f529cdd62674eb8.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_f1f68e42a8d7b3387f529cdd62674eb8.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d607af90>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_b5f8dcf06589eb503c6c7742ad738636.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_b5f8dcf06589eb503c6c7742ad738636.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_0955a85fbd1ffd443d051d1fe2911479.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_a9336838c32a63f1d01e81519090dfd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d605ddd0>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_0955a85fbd1ffd443d051d1fe2911479.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_0955a85fbd1ffd443d051d1fe2911479.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_ed60c4b6407a078b0cf8994e37b0314f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6050cd0>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_a9336838c32a63f1d01e81519090dfd0.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_a9336838c32a63f1d01e81519090dfd0.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6022b50>
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fc3%252F52c3267e397503b52232ff703dcc15f2%252Fpa%252FPC48773_ed60c4b6407a078b0cf8994e37b0314f.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_ed60c4b6407a078b0cf8994e37b0314f.jpg saved to cache
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07142ec8-160c-5cc6-8985-5e335a12467d
2026-03-30 12:16:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07142ec8-160c-5cc6-8985-5e335a12467d, skipping ID generation
2026-03-30 12:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07142ec8-160c-5cc6-8985-5e335a12467d with scrape type 1
2026-03-30 12:16:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07142ec8-160c-5cc6-8985-5e335a12467d sending to next pipeline
2026-03-30 12:16:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07142ec8-160c-5cc6-8985-5e335a12467d, identifier: PC48773
2026-03-30 12:16:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07142ec8-160c-5cc6-8985-5e335a12467d with identifier: PC48773
2026-03-30 12:16:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07142ec8-160c-5cc6-8985-5e335a12467d with identifier: PC48773
2026-03-30 12:16:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07142ec8-160c-5cc6-8985-5e335a12467d with identifier: PC48773 to the API
2026-03-30 12:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_ed60c4b6407a078b0cf8994e37b0314f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 309,
 'expiration_date': '2026-03-31T15:29:53Z',
 'fuel_type': 'hybrid',
 'id': '07142ec8-160c-5cc6-8985-5e335a12467d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P494LG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC48773',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 83712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_ed60c4b6407a078b0cf8994e37b0314f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_a9336838c32a63f1d01e81519090dfd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_0955a85fbd1ffd443d051d1fe2911479.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_b5f8dcf06589eb503c6c7742ad738636.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_f1f68e42a8d7b3387f529cdd62674eb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_9d2754a49b0d9b2197729065eb449ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_55a5ddaa2e4d965a607a3ba388c24e2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_52cfb1fbd9719896f72096c42d677ead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_2d667d2393bdbaca43237fc59c9389ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07142ec8-160c-5cc6-8985-5e335a12467d/07142ec8-160c-5cc6-8985-5e335a12467d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/c3/52c3267e397503b52232ff703dcc15f2/pa/PC48773_32296e07ad31f9f7897a2f4648830bbe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2020}
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC48773%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [auto1.nl] INFO: Saving data for PC48773: {'created_time': 1774873004.177259, 'last_price_update_time': 1774873004.17727, 'auction_closing_time': 1774970993.0}
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PC48773') HTTP/1.1" 204 0
2026-03-30 12:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK82008> (referer: https://www.auto1.com/v1/car-details-view/VK82008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e626ed0-42af-5384-8aa8-c9b0374e8e5a with identifier: VK82008
2026-03-30 12:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a with scrape type 1
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_dfad601e1ca602af3498853b089e0dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_dfad601e1ca602af3498853b089e0dc3.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_f84c1aed044913e138154f2f6485fab8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_f84c1aed044913e138154f2f6485fab8.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_350d00c923a1a5601ac21ac74f3b1543.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_350d00c923a1a5601ac21ac74f3b1543.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_1c5a198e8f71ac2b4f5b386a44f11517.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_1c5a198e8f71ac2b4f5b386a44f11517.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_fd05c5fdcc0b4ac516b6b669013bfbce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_fd05c5fdcc0b4ac516b6b669013bfbce.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_edc940e4338cd0e3de81a10a481bfe66.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_edc940e4338cd0e3de81a10a481bfe66.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_027a9e81521743ff067626b4cb0fd713.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_027a9e81521743ff067626b4cb0fd713.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_d8faf587a713e5ac26c895ec6e41b516.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_d8faf587a713e5ac26c895ec6e41b516.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_ffbdecf8a3928f6345fe76155a84012f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_ffbdecf8a3928f6345fe76155a84012f.jpg not downloaded yet
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_a62e3f0e61ac11c638e149068c2aadcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_a62e3f0e61ac11c638e149068c2aadcd.jpg not downloaded yet
2026-03-30 12:16:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:45 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 1028 | hits on page: 40
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: HT64280
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT64280%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for HT64280: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: PA93170
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: HW70134
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW70134%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for HW70134: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: DG65388
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: XV56308
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV56308%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for XV56308: 1
2026-03-30 12:16:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_a62e3f0e61ac11c638e149068c2aadcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: LL79212
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL79212%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for LL79212: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: HZ15227
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ15227%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for HZ15227: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: WY41439
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY41439%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for WY41439: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: VE97285
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: PL69389
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: RZ24490
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RZ24490%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for RZ24490: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: HH64260
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH64260%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for HH64260: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: TH23479
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH23479%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for TH23479: 1
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: TF99899
2026-03-30 12:16:45 [auto1.nl] INFO: Found listing with ID: WA26878
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA26878%27 HTTP/1.1" 200 None
2026-03-30 12:16:45 [auto1.nl] INFO: Scrape type for WA26878: 2
2026-03-30 12:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ba1c4ad-3d26-5249-bcdf-8ebf5c134885 with identifier: WA26878
2026-03-30 12:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ba1c4ad-3d26-5249-bcdf-8ebf5c134885 with scrape type 2
2026-03-30 12:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ba1c4ad-3d26-5249-bcdf-8ebf5c134885 with scrape type 2
2026-03-30 12:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ba1c4ad-3d26-5249-bcdf-8ebf5c134885, identifier: WA26878
2026-03-30 12:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ba1c4ad-3d26-5249-bcdf-8ebf5c134885 with identifier: WA26878
2026-03-30 12:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ba1c4ad-3d26-5249-bcdf-8ebf5c134885 with identifier: WA26878
2026-03-30 12:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ba1c4ad-3d26-5249-bcdf-8ebf5c134885 with identifier: WA26878 to the API
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:23:28Z',
 'fuel_type': 'diesel',
 'id': '2ba1c4ad-3d26-5249-bcdf-8ebf5c134885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA26878',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 193380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Volvo V70 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2015}
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA26878%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [auto1.nl] INFO: Saving data for WA26878: {'auction_closing_time': 1774970608.0, 'created_time': 1773404839.649329, 'last_price_update_time': 1774873006.299451}
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WA26878') HTTP/1.1" 204 0
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc91a050>
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_a62e3f0e61ac11c638e149068c2aadcd.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_a62e3f0e61ac11c638e149068c2aadcd.jpg saved to cache
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: XA68110
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: VX45692
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX45692%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [auto1.nl] INFO: Scrape type for VX45692: 1
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: MN29097
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: VH66359
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: VH78180
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH78180%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [auto1.nl] INFO: Scrape type for VH78180: 1
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: DT78754
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT78754%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [auto1.nl] INFO: Scrape type for DT78754: 1
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: LV75014
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: YT28903
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: JJ19823
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ19823%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [auto1.nl] INFO: Scrape type for JJ19823: 1
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: UU09064
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU09064%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [auto1.nl] INFO: Scrape type for UU09064: 1
2026-03-30 12:16:46 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [auto1.nl] INFO: Scrape type for BX68417: 2
2026-03-30 12:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417
2026-03-30 12:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e67252f4-3c2e-5c24-9311-9e28f9964461 with scrape type 2
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e67252f4-3c2e-5c24-9311-9e28f9964461 with scrape type 2
2026-03-30 12:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e67252f4-3c2e-5c24-9311-9e28f9964461, identifier: BX68417
2026-03-30 12:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417
2026-03-30 12:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417
2026-03-30 12:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417 to the API
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:16:55Z',
 'fuel_type': 'petrol',
 'id': 'e67252f4-3c2e-5c24-9311-9e28f9964461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX68417',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 193426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-02',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-30 12:16:47 [auto1.nl] INFO: Saving data for BX68417: {'auction_closing_time': 1774970215.0, 'created_time': 1774527058.137435, 'last_price_update_time': 1774873007.033014}
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BX68417') HTTP/1.1" 204 0
2026-03-30 12:16:47 [auto1.nl] INFO: Found listing with ID: RD99814
2026-03-30 12:16:47 [auto1.nl] INFO: Found listing with ID: KE17571
2026-03-30 12:16:47 [auto1.nl] INFO: Found listing with ID: LN49796
2026-03-30 12:16:47 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-30 12:16:47 [auto1.nl] INFO: Scrape type for FU47491: 2
2026-03-30 12:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491
2026-03-30 12:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f247b869-698f-59d3-bc8c-18e9c26a6e85 with scrape type 2
2026-03-30 12:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f247b869-698f-59d3-bc8c-18e9c26a6e85 with scrape type 2
2026-03-30 12:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f247b869-698f-59d3-bc8c-18e9c26a6e85, identifier: FU47491
2026-03-30 12:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491
2026-03-30 12:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491
2026-03-30 12:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491 to the API
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:22:41Z',
 'fuel_type': 'petrol',
 'id': 'f247b869-698f-59d3-bc8c-18e9c26a6e85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU47491',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 129963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-30 12:16:47 [auto1.nl] INFO: Saving data for FU47491: {'auction_closing_time': 1774970561.0, 'created_time': 1774527084.979726, 'last_price_update_time': 1774873007.578639}
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FU47491') HTTP/1.1" 204 0
2026-03-30 12:16:47 [auto1.nl] INFO: Found listing with ID: GC49424
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC49424%27 HTTP/1.1" 200 None
2026-03-30 12:16:47 [auto1.nl] INFO: Scrape type for GC49424: 1
2026-03-30 12:16:47 [auto1.nl] INFO: Found listing with ID: ZH14552
2026-03-30 12:16:47 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-30 12:16:47 [auto1.nl] INFO: Scrape type for FC55354: 2
2026-03-30 12:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354
2026-03-30 12:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with scrape type 2
2026-03-30 12:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with scrape type 2
2026-03-30 12:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d, identifier: FC55354
2026-03-30 12:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354
2026-03-30 12:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354
2026-03-30 12:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354 to the API
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:25Z',
 'fuel_type': 'diesel',
 'id': 'b23168ed-66d2-58db-9ece-2dbc3e9e2e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC55354',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 149406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-13',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Saving data for FC55354: {'auction_closing_time': 1774970605.0, 'created_time': 1774527064.842093, 'last_price_update_time': 1774873008.04954}
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC55354') HTTP/1.1" 204 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: BU60882
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU60882%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for BU60882: 1
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: FZ71545
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: AJ76364
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: LY70010
2026-03-30 12:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX35760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT18437/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC94217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF01238> (referer: https://www.auto1.com/v1/car-details-view/EF01238/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64b28c53-0e49-5770-bd24-f4249fb5a40d with identifier: EF01238
2026-03-30 12:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b28c53-0e49-5770-bd24-f4249fb5a40d with scrape type 1
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_38abffbda06ce356a042f2cac737cbdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_38abffbda06ce356a042f2cac737cbdf.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_259df9209c7f1b8a1707b1ef3f96f41e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_259df9209c7f1b8a1707b1ef3f96f41e.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_e744a3b8e4fff7b3d9a9855d5023acb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_e744a3b8e4fff7b3d9a9855d5023acb0.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_20491a67127fb524d668444e67aea6f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_20491a67127fb524d668444e67aea6f5.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_bd5f30aa1d90e76dddd0b1eb55018eb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_bd5f30aa1d90e76dddd0b1eb55018eb1.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_2163c9b837c106cb6cd9bd523a21f36f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_2163c9b837c106cb6cd9bd523a21f36f.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_4c1fb2cb1f050437bd0ff09ea9a935b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_4c1fb2cb1f050437bd0ff09ea9a935b5.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_ac3a8d7535e1a73546b0ab6b9f6d7291.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_ac3a8d7535e1a73546b0ab6b9f6d7291.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_6e1e5c4819c04d6e02a0c6511ff3151f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_6e1e5c4819c04d6e02a0c6511ff3151f.jpg not downloaded yet
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_77c9016f5b85731f18baa357dfc217ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_77c9016f5b85731f18baa357dfc217ad.jpg not downloaded yet
2026-03-30 12:16:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU12312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_77c9016f5b85731f18baa357dfc217ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d605a610>
2026-03-30 12:16:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_77c9016f5b85731f18baa357dfc217ad.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_77c9016f5b85731f18baa357dfc217ad.jpg saved to cache
2026-03-30 12:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:07 [scrapy.extensions.logstats] INFO: Crawled 27 pages (at 25 pages/min), scraped 16 items (at 16 items/min)
2026-03-30 12:17:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-30 12:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH86542> (referer: https://www.auto1.com/v1/car-details-view/ZH86542/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b295fd67-27f8-5310-8400-fabbb6bc5137 with identifier: ZH86542
2026-03-30 12:17:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b295fd67-27f8-5310-8400-fabbb6bc5137 with scrape type 1
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b295fd67-27f8-5310-8400-fabbb6bc5137
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_e6e19b3a27bb4e4411c88ff109ff0071.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_e6e19b3a27bb4e4411c88ff109ff0071.jpg not downloaded yet
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_542ec17fcabe6c908e7a5a5d54307622.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_542ec17fcabe6c908e7a5a5d54307622.jpg not downloaded yet
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_dd65c4365ec19749ff312cd4e5284baa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_dd65c4365ec19749ff312cd4e5284baa.jpg not downloaded yet
2026-03-30 12:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_6e1e5c4819c04d6e02a0c6511ff3151f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_69608e5be0d3137cf47411c3a70df3bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_69608e5be0d3137cf47411c3a70df3bf.jpg not downloaded yet
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_33f15e0c7c10ccfa12957c26c6d1811a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_33f15e0c7c10ccfa12957c26c6d1811a.jpg not downloaded yet
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_944a011e1dcd19785708eedea78c07f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_944a011e1dcd19785708eedea78c07f7.jpg not downloaded yet
2026-03-30 12:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_dd65c4365ec19749ff312cd4e5284baa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603d290>
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_6e1e5c4819c04d6e02a0c6511ff3151f.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_6e1e5c4819c04d6e02a0c6511ff3151f.jpg saved to cache
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_944a011e1dcd19785708eedea78c07f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_33f15e0c7c10ccfa12957c26c6d1811a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a75810>
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_dd65c4365ec19749ff312cd4e5284baa.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_dd65c4365ec19749ff312cd4e5284baa.jpg saved to cache
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b295fd67-27f8-5310-8400-fabbb6bc5137
2026-03-30 12:17:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69704d0>
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_944a011e1dcd19785708eedea78c07f7.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_944a011e1dcd19785708eedea78c07f7.jpg saved to cache
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b295fd67-27f8-5310-8400-fabbb6bc5137
2026-03-30 12:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_69608e5be0d3137cf47411c3a70df3bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69368d0>
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_33f15e0c7c10ccfa12957c26c6d1811a.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_33f15e0c7c10ccfa12957c26c6d1811a.jpg saved to cache
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b295fd67-27f8-5310-8400-fabbb6bc5137
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a74a50>
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_69608e5be0d3137cf47411c3a70df3bf.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_69608e5be0d3137cf47411c3a70df3bf.jpg saved to cache
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b295fd67-27f8-5310-8400-fabbb6bc5137
2026-03-30 12:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_542ec17fcabe6c908e7a5a5d54307622.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_e6e19b3a27bb4e4411c88ff109ff0071.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d602d290>
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_542ec17fcabe6c908e7a5a5d54307622.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_542ec17fcabe6c908e7a5a5d54307622.jpg saved to cache
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b295fd67-27f8-5310-8400-fabbb6bc5137
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aa3350>
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1db22263aad4671fa449449d8f397a%252Fpa%252FZH86542_e6e19b3a27bb4e4411c88ff109ff0071.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_e6e19b3a27bb4e4411c88ff109ff0071.jpg saved to cache
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b295fd67-27f8-5310-8400-fabbb6bc5137
2026-03-30 12:17:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b295fd67-27f8-5310-8400-fabbb6bc5137, skipping ID generation
2026-03-30 12:17:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b295fd67-27f8-5310-8400-fabbb6bc5137 with scrape type 1
2026-03-30 12:17:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b295fd67-27f8-5310-8400-fabbb6bc5137 sending to next pipeline
2026-03-30 12:17:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b295fd67-27f8-5310-8400-fabbb6bc5137, identifier: ZH86542
2026-03-30 12:17:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b295fd67-27f8-5310-8400-fabbb6bc5137 with identifier: ZH86542
2026-03-30 12:17:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b295fd67-27f8-5310-8400-fabbb6bc5137 with identifier: ZH86542
2026-03-30 12:17:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b295fd67-27f8-5310-8400-fabbb6bc5137 with identifier: ZH86542 to the API
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_e6e19b3a27bb4e4411c88ff109ff0071.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:06:58Z',
 'fuel_type': 'electro',
 'id': 'b295fd67-27f8-5310-8400-fabbb6bc5137',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH86542',
 'listing': 'auction',
 'location': 'NL',
 'make': 'BMW',
 'model': 'i4',
 'odometer': 125152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446611,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_e6e19b3a27bb4e4411c88ff109ff0071.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390529,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_542ec17fcabe6c908e7a5a5d54307622.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427475,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_dd65c4365ec19749ff312cd4e5284baa.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413738,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_69608e5be0d3137cf47411c3a70df3bf.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456489,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_33f15e0c7c10ccfa12957c26c6d1811a.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b295fd67-27f8-5310-8400-fabbb6bc5137/b295fd67-27f8-5310-8400-fabbb6bc5137_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357667,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1db22263aad4671fa449449d8f397a/pa/ZH86542_944a011e1dcd19785708eedea78c07f7.jpg',
             'Width': 1365}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW i4 eDrive40 Gran Coupe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZH86542%27 HTTP/1.1" 200 None
2026-03-30 12:17:43 [auto1.nl] INFO: Saving data for ZH86542: {'created_time': 1774873063.227911, 'last_price_update_time': 1774873063.22792, 'auction_closing_time': 1774969618.0}
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZH86542') HTTP/1.1" 204 0
2026-03-30 12:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_ac3a8d7535e1a73546b0ab6b9f6d7291.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6934a50>
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_ac3a8d7535e1a73546b0ab6b9f6d7291.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_ac3a8d7535e1a73546b0ab6b9f6d7291.jpg saved to cache
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_4c1fb2cb1f050437bd0ff09ea9a935b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6057c50>
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_4c1fb2cb1f050437bd0ff09ea9a935b5.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_4c1fb2cb1f050437bd0ff09ea9a935b5.jpg saved to cache
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_2163c9b837c106cb6cd9bd523a21f36f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6980c90>
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_2163c9b837c106cb6cd9bd523a21f36f.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_2163c9b837c106cb6cd9bd523a21f36f.jpg saved to cache
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_bd5f30aa1d90e76dddd0b1eb55018eb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603ec50>
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_bd5f30aa1d90e76dddd0b1eb55018eb1.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_bd5f30aa1d90e76dddd0b1eb55018eb1.jpg saved to cache
2026-03-30 12:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_20491a67127fb524d668444e67aea6f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6059c90>
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_20491a67127fb524d668444e67aea6f5.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_20491a67127fb524d668444e67aea6f5.jpg saved to cache
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_e744a3b8e4fff7b3d9a9855d5023acb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a76a90>
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_e744a3b8e4fff7b3d9a9855d5023acb0.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_e744a3b8e4fff7b3d9a9855d5023acb0.jpg saved to cache
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_259df9209c7f1b8a1707b1ef3f96f41e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_38abffbda06ce356a042f2cac737cbdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6981d90>
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_259df9209c7f1b8a1707b1ef3f96f41e.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_259df9209c7f1b8a1707b1ef3f96f41e.jpg saved to cache
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60cd5d0>
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff3%252F5bf331971e339f766c4550dfe1e950e9%252Fpa%252FEF01238_38abffbda06ce356a042f2cac737cbdf.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_38abffbda06ce356a042f2cac737cbdf.jpg saved to cache
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64b28c53-0e49-5770-bd24-f4249fb5a40d
2026-03-30 12:17:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64b28c53-0e49-5770-bd24-f4249fb5a40d, skipping ID generation
2026-03-30 12:17:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b28c53-0e49-5770-bd24-f4249fb5a40d with scrape type 1
2026-03-30 12:17:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64b28c53-0e49-5770-bd24-f4249fb5a40d sending to next pipeline
2026-03-30 12:17:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64b28c53-0e49-5770-bd24-f4249fb5a40d, identifier: EF01238
2026-03-30 12:17:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64b28c53-0e49-5770-bd24-f4249fb5a40d with identifier: EF01238
2026-03-30 12:17:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64b28c53-0e49-5770-bd24-f4249fb5a40d with identifier: EF01238
2026-03-30 12:17:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64b28c53-0e49-5770-bd24-f4249fb5a40d with identifier: EF01238 to the API
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_38abffbda06ce356a042f2cac737cbdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:30:39Z',
 'fuel_type': 'diesel',
 'id': '64b28c53-0e49-5770-bd24-f4249fb5a40d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'VTL88P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF01238',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 56948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59241,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_38abffbda06ce356a042f2cac737cbdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58431,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_259df9209c7f1b8a1707b1ef3f96f41e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55076,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_e744a3b8e4fff7b3d9a9855d5023acb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51903,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_20491a67127fb524d668444e67aea6f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51488,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_bd5f30aa1d90e76dddd0b1eb55018eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54839,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_2163c9b837c106cb6cd9bd523a21f36f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53835,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_4c1fb2cb1f050437bd0ff09ea9a935b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59536,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_ac3a8d7535e1a73546b0ab6b9f6d7291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56024,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_6e1e5c4819c04d6e02a0c6511ff3151f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b28c53-0e49-5770-bd24-f4249fb5a40d/64b28c53-0e49-5770-bd24-f4249fb5a40d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55236,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f3/5bf331971e339f766c4550dfe1e950e9/pa/EF01238_77c9016f5b85731f18baa357dfc217ad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2023}
2026-03-30 12:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF01238%27 HTTP/1.1" 200 None
2026-03-30 12:17:45 [auto1.nl] INFO: Saving data for EF01238: {'created_time': 1774873065.060652, 'last_price_update_time': 1774873065.060662, 'auction_closing_time': 1774971039.0}
2026-03-30 12:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EF01238') HTTP/1.1" 204 0
2026-03-30 12:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF89493/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:07 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 2 pages/min), scraped 18 items (at 2 items/min)
2026-03-30 12:18:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 12:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN42241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.710(s), this was the 1st time calling it.
2026-03-30 12:18:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.2751713571625265 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.730(s), this was the 1st time calling it.
2026-03-30 12:18:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.749156961984896 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.777(s), this was the 1st time calling it.
2026-03-30 12:18:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.820159068256218 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF31929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.841(s), this was the 1st time calling it.
2026-03-30 12:18:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.531112585817947 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV08873/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX35760> (referer: https://www.auto1.com/v1/car-details-view/WX35760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a523349-eb53-5349-bf98-d0d9ab67657b with identifier: WX35760
2026-03-30 12:18:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a523349-eb53-5349-bf98-d0d9ab67657b with scrape type 1
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_e741737c120cdc6e40bb6c2a1dd8176f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_e741737c120cdc6e40bb6c2a1dd8176f.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_faee39fb4456d44612bf346e24ea6177.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_faee39fb4456d44612bf346e24ea6177.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_f4050482c01566822487c00d297e9cda.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_f4050482c01566822487c00d297e9cda.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_9c6bfb34c0b8b82553f91263a278b1f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c6bfb34c0b8b82553f91263a278b1f6.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_92ec239b3d5862d4033bcf48cc6cadf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_92ec239b3d5862d4033bcf48cc6cadf1.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_611d61b4025f49fa12c8015c07a1055c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_611d61b4025f49fa12c8015c07a1055c.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_ac2f8230deab659be1b9b19c224d09fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_ac2f8230deab659be1b9b19c224d09fa.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_090963efed02450c3a55cdee7d39984c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_090963efed02450c3a55cdee7d39984c.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_cb1d83a52833435007fe14adb0cfd353.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_cb1d83a52833435007fe14adb0cfd353.jpg not downloaded yet
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_9c892bae6ba30f058402f7ae5a7aeb2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c892bae6ba30f058402f7ae5a7aeb2e.jpg not downloaded yet
2026-03-30 12:18:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.571(s), this was the 1st time calling it.
2026-03-30 12:18:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.648915415448952 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV56308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c892bae6ba30f058402f7ae5a7aeb2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6078210>
2026-03-30 12:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_9c892bae6ba30f058402f7ae5a7aeb2e.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c892bae6ba30f058402f7ae5a7aeb2e.jpg saved to cache
2026-03-30 12:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL70871> (referer: https://www.auto1.com/v1/car-details-view/DL70871/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_cb1d83a52833435007fe14adb0cfd353.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_090963efed02450c3a55cdee7d39984c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8df5c48-52ba-581d-ae6c-5ac456946e0f with identifier: DL70871
2026-03-30 12:19:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8df5c48-52ba-581d-ae6c-5ac456946e0f with scrape type 1
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d8df5c48-52ba-581d-ae6c-5ac456946e0f
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_a3cd3b9872d78e3cb5748c0bb63d79ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_a3cd3b9872d78e3cb5748c0bb63d79ab.jpg not downloaded yet
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_cb0688d767a43742849c598a2ef5b06d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_cb0688d767a43742849c598a2ef5b06d.jpg not downloaded yet
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_ac2f8230deab659be1b9b19c224d09fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_d2c988e1b8c75a42493b5a736dcff530.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_d2c988e1b8c75a42493b5a736dcff530.jpg not downloaded yet
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_c34d14f92072cf2c8701a96b01675223.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c34d14f92072cf2c8701a96b01675223.jpg not downloaded yet
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc93d390>
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_cb1d83a52833435007fe14adb0cfd353.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_cb1d83a52833435007fe14adb0cfd353.jpg saved to cache
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f289d0>
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_090963efed02450c3a55cdee7d39984c.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_090963efed02450c3a55cdee7d39984c.jpg saved to cache
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_c2e4ada91a275cbaac1db475b30239e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c2e4ada91a275cbaac1db475b30239e5.jpg not downloaded yet
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_a3cd3b9872d78e3cb5748c0bb63d79ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_9a9f75a0739696884ff62ac90ced8205.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_9a9f75a0739696884ff62ac90ced8205.jpg not downloaded yet
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f32c10>
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_ac2f8230deab659be1b9b19c224d09fa.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_ac2f8230deab659be1b9b19c224d09fa.jpg saved to cache
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.530(s), this was the 1st time calling it.
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.522265464261445 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c34d14f92072cf2c8701a96b01675223.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f079d0>
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_a3cd3b9872d78e3cb5748c0bb63d79ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_a3cd3b9872d78e3cb5748c0bb63d79ab.jpg saved to cache
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8df5c48-52ba-581d-ae6c-5ac456946e0f
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_9a9f75a0739696884ff62ac90ced8205.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f31e90>
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_c34d14f92072cf2c8701a96b01675223.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c34d14f92072cf2c8701a96b01675223.jpg saved to cache
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8df5c48-52ba-581d-ae6c-5ac456946e0f
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c2e4ada91a275cbaac1db475b30239e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_d2c988e1b8c75a42493b5a736dcff530.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60fb550>
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_9a9f75a0739696884ff62ac90ced8205.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_9a9f75a0739696884ff62ac90ced8205.jpg saved to cache
2026-03-30 12:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8df5c48-52ba-581d-ae6c-5ac456946e0f
2026-03-30 12:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_cb0688d767a43742849c598a2ef5b06d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f31350>
2026-03-30 12:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_c2e4ada91a275cbaac1db475b30239e5.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c2e4ada91a275cbaac1db475b30239e5.jpg saved to cache
2026-03-30 12:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8df5c48-52ba-581d-ae6c-5ac456946e0f
2026-03-30 12:19:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_611d61b4025f49fa12c8015c07a1055c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f04110>
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_d2c988e1b8c75a42493b5a736dcff530.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_d2c988e1b8c75a42493b5a736dcff530.jpg saved to cache
2026-03-30 12:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8df5c48-52ba-581d-ae6c-5ac456946e0f
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f29c10>
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F34%252Fcc34e20d6b9b68b39782944735e935d9%252Fpa%252FDL70871_cb0688d767a43742849c598a2ef5b06d.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_cb0688d767a43742849c598a2ef5b06d.jpg saved to cache
2026-03-30 12:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8df5c48-52ba-581d-ae6c-5ac456946e0f
2026-03-30 12:19:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8df5c48-52ba-581d-ae6c-5ac456946e0f, skipping ID generation
2026-03-30 12:19:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8df5c48-52ba-581d-ae6c-5ac456946e0f with scrape type 1
2026-03-30 12:19:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8df5c48-52ba-581d-ae6c-5ac456946e0f sending to next pipeline
2026-03-30 12:19:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d8df5c48-52ba-581d-ae6c-5ac456946e0f, identifier: DL70871
2026-03-30 12:19:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d8df5c48-52ba-581d-ae6c-5ac456946e0f with identifier: DL70871
2026-03-30 12:19:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d8df5c48-52ba-581d-ae6c-5ac456946e0f with identifier: DL70871
2026-03-30 12:19:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d8df5c48-52ba-581d-ae6c-5ac456946e0f with identifier: DL70871 to the API
2026-03-30 12:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_cb0688d767a43742849c598a2ef5b06d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:12:55Z',
 'fuel_type': 'petrol',
 'id': 'd8df5c48-52ba-581d-ae6c-5ac456946e0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL70871',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 149089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123174,
             'Height': 575,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_a3cd3b9872d78e3cb5748c0bb63d79ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109990,
             'Height': 560,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_cb0688d767a43742849c598a2ef5b06d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_d2c988e1b8c75a42493b5a736dcff530.jpg',
             'Width': 780},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118401,
             'Height': 539,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c34d14f92072cf2c8701a96b01675223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_c2e4ada91a275cbaac1db475b30239e5.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8df5c48-52ba-581d-ae6c-5ac456946e0f/d8df5c48-52ba-581d-ae6c-5ac456946e0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/34/cc34e20d6b9b68b39782944735e935d9/pa/DL70871_9a9f75a0739696884ff62ac90ced8205.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Center-Line AWD',
 'transmission': 'automatic',
 'trim': 'Center-Line AWD',
 'year': 2014}
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL70871%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [auto1.nl] INFO: Saving data for DL70871: {'created_time': 1774873143.197332, 'last_price_update_time': 1774873143.197342, 'auction_closing_time': 1774969975.0}
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DL70871') HTTP/1.1" 204 0
2026-03-30 12:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_92ec239b3d5862d4033bcf48cc6cadf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6acba90>
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_611d61b4025f49fa12c8015c07a1055c.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_611d61b4025f49fa12c8015c07a1055c.jpg saved to cache
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60a6a90>
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_92ec239b3d5862d4033bcf48cc6cadf1.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_92ec239b3d5862d4033bcf48cc6cadf1.jpg saved to cache
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c6bfb34c0b8b82553f91263a278b1f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_f4050482c01566822487c00d297e9cda.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_faee39fb4456d44612bf346e24ea6177.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d600f450>
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_9c6bfb34c0b8b82553f91263a278b1f6.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c6bfb34c0b8b82553f91263a278b1f6.jpg saved to cache
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f05410>
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_f4050482c01566822487c00d297e9cda.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_f4050482c01566822487c00d297e9cda.jpg saved to cache
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60b91d0>
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_faee39fb4456d44612bf346e24ea6177.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_faee39fb4456d44612bf346e24ea6177.jpg saved to cache
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_e741737c120cdc6e40bb6c2a1dd8176f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:19:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:19:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:19:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:19:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f290d0>
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fd8%252Fc6d87d7eaadf067b2fa3ae70a0e1f72f%252Fpa%252FWX35760_e741737c120cdc6e40bb6c2a1dd8176f.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_e741737c120cdc6e40bb6c2a1dd8176f.jpg saved to cache
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a523349-eb53-5349-bf98-d0d9ab67657b
2026-03-30 12:19:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a523349-eb53-5349-bf98-d0d9ab67657b, skipping ID generation
2026-03-30 12:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a523349-eb53-5349-bf98-d0d9ab67657b with scrape type 1
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a523349-eb53-5349-bf98-d0d9ab67657b sending to next pipeline
2026-03-30 12:19:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4a523349-eb53-5349-bf98-d0d9ab67657b, identifier: WX35760
2026-03-30 12:19:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4a523349-eb53-5349-bf98-d0d9ab67657b with identifier: WX35760
2026-03-30 12:19:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4a523349-eb53-5349-bf98-d0d9ab67657b with identifier: WX35760
2026-03-30 12:19:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4a523349-eb53-5349-bf98-d0d9ab67657b with identifier: WX35760 to the API
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_e741737c120cdc6e40bb6c2a1dd8176f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:19:19Z',
 'fuel_type': 'petrol',
 'id': '4a523349-eb53-5349-bf98-d0d9ab67657b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX35760',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 345327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4849423,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_e741737c120cdc6e40bb6c2a1dd8176f.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_faee39fb4456d44612bf346e24ea6177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_f4050482c01566822487c00d297e9cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c6bfb34c0b8b82553f91263a278b1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_92ec239b3d5862d4033bcf48cc6cadf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_611d61b4025f49fa12c8015c07a1055c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_ac2f8230deab659be1b9b19c224d09fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_090963efed02450c3a55cdee7d39984c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_cb1d83a52833435007fe14adb0cfd353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a523349-eb53-5349-bf98-d0d9ab67657b/4a523349-eb53-5349-bf98-d0d9ab67657b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/d8/c6d87d7eaadf067b2fa3ae70a0e1f72f/pa/WX35760_9c892bae6ba30f058402f7ae5a7aeb2e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2011}
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX35760%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.nl] INFO: Saving data for WX35760: {'created_time': 1774873144.452828, 'last_price_update_time': 1774873144.452838, 'auction_closing_time': 1774970359.0}
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WX35760') HTTP/1.1" 204 0
2026-03-30 12:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU12312> (referer: https://www.auto1.com/v1/car-details-view/NU12312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ54414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5b89f40-15b8-5f67-ac41-d84f7a9b64b1 with identifier: NU12312
2026-03-30 12:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1 with scrape type 1
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_923773933b75622778efbb690eb86054.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_923773933b75622778efbb690eb86054.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_488a25c62f166d4c8ec7220c7780eafd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_488a25c62f166d4c8ec7220c7780eafd.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_f7a51459a0827cca038cf5dc7c18ade3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_f7a51459a0827cca038cf5dc7c18ade3.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_71e3bc0fea230a6c35465432e0e8bb3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_71e3bc0fea230a6c35465432e0e8bb3a.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_114aa739924757906f20d93bb1e3994c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_114aa739924757906f20d93bb1e3994c.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_089664703ec0ca2265f4905a85a6e25f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_089664703ec0ca2265f4905a85a6e25f.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_bcd885d3b7614956c032bfc080a0dcd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_bcd885d3b7614956c032bfc080a0dcd4.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_78a570853736c739065d0da19828d6a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_78a570853736c739065d0da19828d6a6.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_ae3b2d36b11998a50c2e119d29b89197.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_ae3b2d36b11998a50c2e119d29b89197.jpg not downloaded yet
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_1feff77bc5084c4dd766b6bd29bcf2a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_1feff77bc5084c4dd766b6bd29bcf2a4.jpg not downloaded yet
2026-03-30 12:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.259(s), this was the 1st time calling it.
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.5376893696987013 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:07 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 8 pages/min), scraped 20 items (at 2 items/min)
2026-03-30 12:19:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 12:19:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC94217> (referer: https://www.auto1.com/v1/car-details-view/KC94217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c646354-973a-586a-81ed-b416d19c25a9 with identifier: KC94217
2026-03-30 12:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c646354-973a-586a-81ed-b416d19c25a9 with scrape type 1
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_f051b0cafa5513e9590a3299773a0f4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f051b0cafa5513e9590a3299773a0f4a.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_5e5d6f250fc524977ee1b9c7805a7358.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5e5d6f250fc524977ee1b9c7805a7358.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_d5e9fc9ca3086a84bdbe8aff888005ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_d5e9fc9ca3086a84bdbe8aff888005ff.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_4dfb167e02828e55e76f4d99ee74c55b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_4dfb167e02828e55e76f4d99ee74c55b.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_46fab81540b2bbbb3f047c752551beea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_46fab81540b2bbbb3f047c752551beea.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_f58057c9d6f6b09d1ec971a81a6e4532.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f58057c9d6f6b09d1ec971a81a6e4532.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_28f50747c521292f5dc5cdcf29a2bf47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_28f50747c521292f5dc5cdcf29a2bf47.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_5844a161752df24cb3f6699bb0d8b127.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5844a161752df24cb3f6699bb0d8b127.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_ed8cd08ece267f56dad604c26ba8e1ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_ed8cd08ece267f56dad604c26ba8e1ff.jpg not downloaded yet
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_135a69df05bba9ff0b18227bac8ec774.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_135a69df05bba9ff0b18227bac8ec774.jpg not downloaded yet
2026-03-30 12:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_1feff77bc5084c4dd766b6bd29bcf2a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_135a69df05bba9ff0b18227bac8ec774.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_ed8cd08ece267f56dad604c26ba8e1ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d690ced0>
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_1feff77bc5084c4dd766b6bd29bcf2a4.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_1feff77bc5084c4dd766b6bd29bcf2a4.jpg saved to cache
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d691da10>
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_135a69df05bba9ff0b18227bac8ec774.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_135a69df05bba9ff0b18227bac8ec774.jpg saved to cache
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aa1910>
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_ed8cd08ece267f56dad604c26ba8e1ff.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_ed8cd08ece267f56dad604c26ba8e1ff.jpg saved to cache
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5844a161752df24cb3f6699bb0d8b127.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_28f50747c521292f5dc5cdcf29a2bf47.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6036cd0>
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_5844a161752df24cb3f6699bb0d8b127.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5844a161752df24cb3f6699bb0d8b127.jpg saved to cache
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f58057c9d6f6b09d1ec971a81a6e4532.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6036c90>
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_28f50747c521292f5dc5cdcf29a2bf47.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_28f50747c521292f5dc5cdcf29a2bf47.jpg saved to cache
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60341d0>
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_f58057c9d6f6b09d1ec971a81a6e4532.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f58057c9d6f6b09d1ec971a81a6e4532.jpg saved to cache
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_46fab81540b2bbbb3f047c752551beea.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_4dfb167e02828e55e76f4d99ee74c55b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d691ca10>
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_46fab81540b2bbbb3f047c752551beea.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_46fab81540b2bbbb3f047c752551beea.jpg saved to cache
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d694b8d0>
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_4dfb167e02828e55e76f4d99ee74c55b.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_4dfb167e02828e55e76f4d99ee74c55b.jpg saved to cache
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_d5e9fc9ca3086a84bdbe8aff888005ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5e5d6f250fc524977ee1b9c7805a7358.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6057490>
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_d5e9fc9ca3086a84bdbe8aff888005ff.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_d5e9fc9ca3086a84bdbe8aff888005ff.jpg saved to cache
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d605f150>
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_5e5d6f250fc524977ee1b9c7805a7358.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5e5d6f250fc524977ee1b9c7805a7358.jpg saved to cache
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f051b0cafa5513e9590a3299773a0f4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_ae3b2d36b11998a50c2e119d29b89197.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF89493> (referer: https://www.auto1.com/v1/car-details-view/NF89493/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f2fa50>
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc9%252F4dc933d180220f91c4a039981c92470c%252Fpa%252FKC94217_f051b0cafa5513e9590a3299773a0f4a.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f051b0cafa5513e9590a3299773a0f4a.jpg saved to cache
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c646354-973a-586a-81ed-b416d19c25a9
2026-03-30 12:19:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c646354-973a-586a-81ed-b416d19c25a9, skipping ID generation
2026-03-30 12:19:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c646354-973a-586a-81ed-b416d19c25a9 with scrape type 1
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c646354-973a-586a-81ed-b416d19c25a9 sending to next pipeline
2026-03-30 12:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2c646354-973a-586a-81ed-b416d19c25a9, identifier: KC94217
2026-03-30 12:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2c646354-973a-586a-81ed-b416d19c25a9 with identifier: KC94217
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2c646354-973a-586a-81ed-b416d19c25a9 with identifier: KC94217
2026-03-30 12:19:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2c646354-973a-586a-81ed-b416d19c25a9 with identifier: KC94217 to the API
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f051b0cafa5513e9590a3299773a0f4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 152,
 'expiration_date': '2026-03-31T15:42:58Z',
 'fuel_type': 'petrol',
 'id': '2c646354-973a-586a-81ed-b416d19c25a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K199KP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC94217',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 117751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2162374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f051b0cafa5513e9590a3299773a0f4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2305673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5e5d6f250fc524977ee1b9c7805a7358.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2184566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_d5e9fc9ca3086a84bdbe8aff888005ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2260098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_4dfb167e02828e55e76f4d99ee74c55b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2215916,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_46fab81540b2bbbb3f047c752551beea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2311320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_f58057c9d6f6b09d1ec971a81a6e4532.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2249376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_28f50747c521292f5dc5cdcf29a2bf47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_5844a161752df24cb3f6699bb0d8b127.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2166777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_ed8cd08ece267f56dad604c26ba8e1ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c646354-973a-586a-81ed-b416d19c25a9/2c646354-973a-586a-81ed-b416d19c25a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385137,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/c9/4dc933d180220f91c4a039981c92470c/pa/KC94217_135a69df05bba9ff0b18227bac8ec774.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 1.5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2016}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC94217%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [auto1.nl] INFO: Saving data for KC94217: {'created_time': 1774873159.215265, 'last_price_update_time': 1774873159.215276, 'auction_closing_time': 1774971778.0}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC94217') HTTP/1.1" 204 0
2026-03-30 12:19:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6934450>
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_ae3b2d36b11998a50c2e119d29b89197.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_ae3b2d36b11998a50c2e119d29b89197.jpg saved to cache
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28aec534-5cc2-51fd-96fb-eebf102ebe78 with identifier: NF89493
2026-03-30 12:19:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28aec534-5cc2-51fd-96fb-eebf102ebe78 with scrape type 1
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 28aec534-5cc2-51fd-96fb-eebf102ebe78
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F88%252F9688e658b197db0dd7b98754320ddd94%252Fpa%252FNF89493_3ac744a29e776b0cac16719eaa769c24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_3ac744a29e776b0cac16719eaa769c24.jpg already downloaded
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F88%252F9688e658b197db0dd7b98754320ddd94%252Fpa%252FNF89493_a3ba643117519fffec48031e9a361964.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_a3ba643117519fffec48031e9a361964.jpg already downloaded
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F88%252F9688e658b197db0dd7b98754320ddd94%252Fpa%252FNF89493_a6bafa6f42774969f658c0fbe36ab940.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_a6bafa6f42774969f658c0fbe36ab940.jpg already downloaded
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F88%252F9688e658b197db0dd7b98754320ddd94%252Fpa%252FNF89493_4d2dcbbeebd84447bc2e05cae32c095d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_4d2dcbbeebd84447bc2e05cae32c095d.jpg already downloaded
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F88%252F9688e658b197db0dd7b98754320ddd94%252Fpa%252FNF89493_e6aa1106dae5ddd8e3252a49489688b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_e6aa1106dae5ddd8e3252a49489688b4.jpg already downloaded
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F88%252F9688e658b197db0dd7b98754320ddd94%252Fpa%252FNF89493_0da33aa412714ca3c4e3ae9914968dea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_0da33aa412714ca3c4e3ae9914968dea.jpg already downloaded
2026-03-30 12:19:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28aec534-5cc2-51fd-96fb-eebf102ebe78, identifier: NF89493
2026-03-30 12:19:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28aec534-5cc2-51fd-96fb-eebf102ebe78 with identifier: NF89493
2026-03-30 12:19:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28aec534-5cc2-51fd-96fb-eebf102ebe78 with identifier: NF89493
2026-03-30 12:19:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28aec534-5cc2-51fd-96fb-eebf102ebe78 with identifier: NF89493 to the API
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF89493>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:13:27Z',
 'fuel_type': 'petrol',
 'id': '28aec534-5cc2-51fd-96fb-eebf102ebe78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '78JDL2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF89493',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 304619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_3ac744a29e776b0cac16719eaa769c24.jpg',
                'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_a3ba643117519fffec48031e9a361964.jpg',
                'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_a6bafa6f42774969f658c0fbe36ab940.jpg',
                'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_4d2dcbbeebd84447bc2e05cae32c095d.jpg',
                'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_e6aa1106dae5ddd8e3252a49489688b4.jpg',
                'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_0da33aa412714ca3c4e3ae9914968dea.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aec534-5cc2-51fd-96fb-eebf102ebe78/28aec534-5cc2-51fd-96fb-eebf102ebe78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_3ac744a29e776b0cac16719eaa769c24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aec534-5cc2-51fd-96fb-eebf102ebe78/28aec534-5cc2-51fd-96fb-eebf102ebe78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_a3ba643117519fffec48031e9a361964.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aec534-5cc2-51fd-96fb-eebf102ebe78/28aec534-5cc2-51fd-96fb-eebf102ebe78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_a6bafa6f42774969f658c0fbe36ab940.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aec534-5cc2-51fd-96fb-eebf102ebe78/28aec534-5cc2-51fd-96fb-eebf102ebe78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_4d2dcbbeebd84447bc2e05cae32c095d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aec534-5cc2-51fd-96fb-eebf102ebe78/28aec534-5cc2-51fd-96fb-eebf102ebe78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_e6aa1106dae5ddd8e3252a49489688b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aec534-5cc2-51fd-96fb-eebf102ebe78/28aec534-5cc2-51fd-96fb-eebf102ebe78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/88/9688e658b197db0dd7b98754320ddd94/pa/NF89493_0da33aa412714ca3c4e3ae9914968dea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volvo C30 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF89493%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [auto1.nl] INFO: Saving data for NF89493: {'created_time': 1774873159.968543, 'last_price_update_time': 1774873159.968555, 'auction_closing_time': 1774970007.0}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF89493') HTTP/1.1" 204 0
2026-03-30 12:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_78a570853736c739065d0da19828d6a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c6910>
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_78a570853736c739065d0da19828d6a6.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_78a570853736c739065d0da19828d6a6.jpg saved to cache
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_089664703ec0ca2265f4905a85a6e25f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_bcd885d3b7614956c032bfc080a0dcd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_71e3bc0fea230a6c35465432e0e8bb3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_114aa739924757906f20d93bb1e3994c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f2bf50>
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_089664703ec0ca2265f4905a85a6e25f.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_089664703ec0ca2265f4905a85a6e25f.jpg saved to cache
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d695b5d0>
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_bcd885d3b7614956c032bfc080a0dcd4.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_bcd885d3b7614956c032bfc080a0dcd4.jpg saved to cache
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f2e8d0>
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_71e3bc0fea230a6c35465432e0e8bb3a.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_71e3bc0fea230a6c35465432e0e8bb3a.jpg saved to cache
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60df3d0>
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_114aa739924757906f20d93bb1e3994c.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_114aa739924757906f20d93bb1e3994c.jpg saved to cache
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_f7a51459a0827cca038cf5dc7c18ade3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_488a25c62f166d4c8ec7220c7780eafd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c3890>
2026-03-30 12:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_f7a51459a0827cca038cf5dc7c18ade3.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_f7a51459a0827cca038cf5dc7c18ade3.jpg saved to cache
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ae9d90>
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_488a25c62f166d4c8ec7220c7780eafd.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_488a25c62f166d4c8ec7220c7780eafd.jpg saved to cache
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_923773933b75622778efbb690eb86054.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ab5f90>
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fbc%252F17bc36694409b4cda5bcb93fd83093e7%252Fpa%252FNU12312_923773933b75622778efbb690eb86054.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_923773933b75622778efbb690eb86054.jpg saved to cache
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1
2026-03-30 12:19:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5b89f40-15b8-5f67-ac41-d84f7a9b64b1, skipping ID generation
2026-03-30 12:19:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1 with scrape type 1
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5b89f40-15b8-5f67-ac41-d84f7a9b64b1 sending to next pipeline
2026-03-30 12:19:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d5b89f40-15b8-5f67-ac41-d84f7a9b64b1, identifier: NU12312
2026-03-30 12:19:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d5b89f40-15b8-5f67-ac41-d84f7a9b64b1 with identifier: NU12312
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 12:19:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:19:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d5b89f40-15b8-5f67-ac41-d84f7a9b64b1 with identifier: NU12312
2026-03-30 12:19:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d5b89f40-15b8-5f67-ac41-d84f7a9b64b1 with identifier: NU12312 to the API
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_923773933b75622778efbb690eb86054.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 358,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '5.7L',
 'engine_horse_power': 401,
 'expiration_date': '2026-03-31T15:16:47Z',
 'fuel_type': 'petrol',
 'id': 'd5b89f40-15b8-5f67-ac41-d84f7a9b64b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'VD042X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU12312',
 'listing': 'auction',
 'location': 'NL, Almere',
 'make': 'Dodge',
 'model': 'Ram 1500',
 'odometer': 409076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_923773933b75622778efbb690eb86054.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2368419,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_488a25c62f166d4c8ec7220c7780eafd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_f7a51459a0827cca038cf5dc7c18ade3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2335385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_71e3bc0fea230a6c35465432e0e8bb3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2342248,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_114aa739924757906f20d93bb1e3994c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2266680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_089664703ec0ca2265f4905a85a6e25f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2307747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_bcd885d3b7614956c032bfc080a0dcd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2328870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_78a570853736c739065d0da19828d6a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479030,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_ae3b2d36b11998a50c2e119d29b89197.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b89f40-15b8-5f67-ac41-d84f7a9b64b1/d5b89f40-15b8-5f67-ac41-d84f7a9b64b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/bc/17bc36694409b4cda5bcb93fd83093e7/pa/NU12312_1feff77bc5084c4dd766b6bd29bcf2a4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dodge Ram 1500 5.7 V8 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2013}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU12312%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.nl] INFO: Saving data for NU12312: {'created_time': 1774873162.141789, 'last_price_update_time': 1774873162.141798, 'auction_closing_time': 1774970207.0}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NU12312') HTTP/1.1" 204 0
2026-03-30 12:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS41016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN42241> (referer: https://www.auto1.com/v1/car-details-view/BN42241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94d99686-57fa-5313-b1c2-7fda2425497b with identifier: BN42241
2026-03-30 12:19:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94d99686-57fa-5313-b1c2-7fda2425497b with scrape type 1
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 94d99686-57fa-5313-b1c2-7fda2425497b
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_cd33f723691799b669aaa0af09554396.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_cd33f723691799b669aaa0af09554396.jpg not downloaded yet
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_b8d69a2dc795c269c7f96757c8171375.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_b8d69a2dc795c269c7f96757c8171375.jpg not downloaded yet
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_a56e49268d4107c609151c90068fd94b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_a56e49268d4107c609151c90068fd94b.jpg not downloaded yet
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_eae2ac7eec1560d52e2c971c6be32db5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_eae2ac7eec1560d52e2c971c6be32db5.jpg not downloaded yet
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_2ecf45f40c206347512c6c95c46764c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_2ecf45f40c206347512c6c95c46764c8.jpg not downloaded yet
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_46a6a4fc76e98f58b1af923116a58f3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_46a6a4fc76e98f58b1af923116a58f3d.jpg not downloaded yet
2026-03-30 12:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV08873> (referer: https://www.auto1.com/v1/car-details-view/SV08873/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_46a6a4fc76e98f58b1af923116a58f3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c80e477-6467-550d-991d-300d3b00d478 with identifier: SV08873
2026-03-30 12:19:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c80e477-6467-550d-991d-300d3b00d478 with scrape type 1
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c80e477-6467-550d-991d-300d3b00d478
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_ae13d895de31bfae4f89e30da14cad2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_ae13d895de31bfae4f89e30da14cad2b.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_8b9056b05aa819133d293fcc713007d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_8b9056b05aa819133d293fcc713007d0.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_f3bb2ff85bc3ba0a1e13874976379ead.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_f3bb2ff85bc3ba0a1e13874976379ead.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_1a01ab6cbfb17511b7ddd89b74c46858.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_1a01ab6cbfb17511b7ddd89b74c46858.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_2e9c1b6c12d81f43e230869e82b80464.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_2e9c1b6c12d81f43e230869e82b80464.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_5b8f29c3a1359247be4858c28440606c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_5b8f29c3a1359247be4858c28440606c.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_08bb6350a957ab37c269e5d5cb72a9c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_08bb6350a957ab37c269e5d5cb72a9c9.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_d396b7f9a49a53456eac94988aec7169.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_d396b7f9a49a53456eac94988aec7169.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_ae534e53a847b855e4590846ce1023ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_ae534e53a847b855e4590846ce1023ff.jpg already downloaded
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F10%252F7910f645da18537c706163371d8d3466%252Fpa%252FSV08873_61c45a163979ebb0a788b2f38ca7b367.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_61c45a163979ebb0a788b2f38ca7b367.jpg already downloaded
2026-03-30 12:19:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5c80e477-6467-550d-991d-300d3b00d478, identifier: SV08873
2026-03-30 12:19:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5c80e477-6467-550d-991d-300d3b00d478 with identifier: SV08873
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 12:19:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:19:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5c80e477-6467-550d-991d-300d3b00d478 with identifier: SV08873
2026-03-30 12:19:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5c80e477-6467-550d-991d-300d3b00d478 with identifier: SV08873 to the API
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV08873>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:10:58Z',
 'fuel_type': 'petrol',
 'id': '5c80e477-6467-550d-991d-300d3b00d478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '52zhz2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV08873',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 70849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_ae13d895de31bfae4f89e30da14cad2b.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_8b9056b05aa819133d293fcc713007d0.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_f3bb2ff85bc3ba0a1e13874976379ead.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_1a01ab6cbfb17511b7ddd89b74c46858.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_2e9c1b6c12d81f43e230869e82b80464.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_5b8f29c3a1359247be4858c28440606c.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_08bb6350a957ab37c269e5d5cb72a9c9.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_d396b7f9a49a53456eac94988aec7169.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_ae534e53a847b855e4590846ce1023ff.jpg',
                'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_61c45a163979ebb0a788b2f38ca7b367.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_ae13d895de31bfae4f89e30da14cad2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_8b9056b05aa819133d293fcc713007d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_f3bb2ff85bc3ba0a1e13874976379ead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_1a01ab6cbfb17511b7ddd89b74c46858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_2e9c1b6c12d81f43e230869e82b80464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_5b8f29c3a1359247be4858c28440606c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_08bb6350a957ab37c269e5d5cb72a9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_d396b7f9a49a53456eac94988aec7169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_ae534e53a847b855e4590846ce1023ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c80e477-6467-550d-991d-300d3b00d478/5c80e477-6467-550d-991d-300d3b00d478_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/10/7910f645da18537c706163371d8d3466/pa/SV08873_61c45a163979ebb0a788b2f38ca7b367.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI CrossPolo',
 'transmission': 'automatic',
 'trim': 'Cross',
 'year': 2012}
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV08873%27 HTTP/1.1" 200 None
2026-03-30 12:19:32 [auto1.nl] INFO: Saving data for SV08873: {'created_time': 1774873172.549218, 'last_price_update_time': 1774873172.549228, 'auction_closing_time': 1774969858.0}
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV08873') HTTP/1.1" 204 0
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9ea5dba10>
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_46a6a4fc76e98f58b1af923116a58f3d.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_46a6a4fc76e98f58b1af923116a58f3d.jpg saved to cache
2026-03-30 12:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94d99686-57fa-5313-b1c2-7fda2425497b
2026-03-30 12:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_2ecf45f40c206347512c6c95c46764c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_eae2ac7eec1560d52e2c971c6be32db5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc93d450>
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_2ecf45f40c206347512c6c95c46764c8.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_2ecf45f40c206347512c6c95c46764c8.jpg saved to cache
2026-03-30 12:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94d99686-57fa-5313-b1c2-7fda2425497b
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60a2a10>
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_eae2ac7eec1560d52e2c971c6be32db5.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_eae2ac7eec1560d52e2c971c6be32db5.jpg saved to cache
2026-03-30 12:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94d99686-57fa-5313-b1c2-7fda2425497b
2026-03-30 12:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_a56e49268d4107c609151c90068fd94b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_b8d69a2dc795c269c7f96757c8171375.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_cd33f723691799b669aaa0af09554396.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ad12d0>
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_a56e49268d4107c609151c90068fd94b.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_a56e49268d4107c609151c90068fd94b.jpg saved to cache
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94d99686-57fa-5313-b1c2-7fda2425497b
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6acb6d0>
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_b8d69a2dc795c269c7f96757c8171375.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_b8d69a2dc795c269c7f96757c8171375.jpg saved to cache
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94d99686-57fa-5313-b1c2-7fda2425497b
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f07fd0>
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F3c%252Fd83c5e95ebd0ab6766faf20d8a5e6523%252Fpa%252FBN42241_cd33f723691799b669aaa0af09554396.jpg') HTTP/1.1" 204 0
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_cd33f723691799b669aaa0af09554396.jpg saved to cache
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94d99686-57fa-5313-b1c2-7fda2425497b
2026-03-30 12:19:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94d99686-57fa-5313-b1c2-7fda2425497b, skipping ID generation
2026-03-30 12:19:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94d99686-57fa-5313-b1c2-7fda2425497b with scrape type 1
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94d99686-57fa-5313-b1c2-7fda2425497b sending to next pipeline
2026-03-30 12:19:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 94d99686-57fa-5313-b1c2-7fda2425497b, identifier: BN42241
2026-03-30 12:19:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 94d99686-57fa-5313-b1c2-7fda2425497b with identifier: BN42241
2026-03-30 12:19:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 94d99686-57fa-5313-b1c2-7fda2425497b with identifier: BN42241
2026-03-30 12:19:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 94d99686-57fa-5313-b1c2-7fda2425497b with identifier: BN42241 to the API
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_cd33f723691799b669aaa0af09554396.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:34:43Z',
 'fuel_type': 'electro',
 'id': '94d99686-57fa-5313-b1c2-7fda2425497b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN42241',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 61456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349718,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_cd33f723691799b669aaa0af09554396.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353257,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_b8d69a2dc795c269c7f96757c8171375.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346844,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_a56e49268d4107c609151c90068fd94b.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351305,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_eae2ac7eec1560d52e2c971c6be32db5.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272590,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_2ecf45f40c206347512c6c95c46764c8.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d99686-57fa-5313-b1c2-7fda2425497b/94d99686-57fa-5313-b1c2-7fda2425497b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402066,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/3c/d83c5e95ebd0ab6766faf20d8a5e6523/pa/BN42241_46a6a4fc76e98f58b1af923116a58f3d.jpg',
             'Width': 1365}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 100 kW GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN42241%27 HTTP/1.1" 200 None
2026-03-30 12:19:33 [auto1.nl] INFO: Saving data for BN42241: {'created_time': 1774873173.837287, 'last_price_update_time': 1774873173.837297, 'auction_closing_time': 1774971283.0}
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN42241') HTTP/1.1" 204 0
2026-03-30 12:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV56308> (referer: https://www.auto1.com/v1/car-details-view/XV56308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ca66bc-df2e-5491-a0d3-f3425bb202dd with identifier: XV56308
2026-03-30 12:19:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ca66bc-df2e-5491-a0d3-f3425bb202dd with scrape type 1
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 05ca66bc-df2e-5491-a0d3-f3425bb202dd
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F91%252Ff0915447f906567470f5a95811ad25cd%252Fpa%252FXV56308_94bd51caa8b371875e18303ff758cf40.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_94bd51caa8b371875e18303ff758cf40.jpg already downloaded
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F91%252Ff0915447f906567470f5a95811ad25cd%252Fpa%252FXV56308_0d9e310c8cabb4e6bbde03c4fb91fb2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_0d9e310c8cabb4e6bbde03c4fb91fb2f.jpg already downloaded
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F91%252Ff0915447f906567470f5a95811ad25cd%252Fpa%252FXV56308_adbdc3a0e25bb46c8f2e785a0b69f3b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_adbdc3a0e25bb46c8f2e785a0b69f3b1.jpg already downloaded
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F91%252Ff0915447f906567470f5a95811ad25cd%252Fpa%252FXV56308_900aeb06a9acfa8bfb62a37dd6f64c42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_900aeb06a9acfa8bfb62a37dd6f64c42.jpg already downloaded
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F91%252Ff0915447f906567470f5a95811ad25cd%252Fpa%252FXV56308_03fe371cd221ea41f0e479ff72bb8e2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_03fe371cd221ea41f0e479ff72bb8e2d.jpg already downloaded
2026-03-30 12:19:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 05ca66bc-df2e-5491-a0d3-f3425bb202dd, identifier: XV56308
2026-03-30 12:19:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 05ca66bc-df2e-5491-a0d3-f3425bb202dd with identifier: XV56308
2026-03-30 12:19:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 05ca66bc-df2e-5491-a0d3-f3425bb202dd with identifier: XV56308
2026-03-30 12:19:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 05ca66bc-df2e-5491-a0d3-f3425bb202dd with identifier: XV56308 to the API
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV56308>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:06:50Z',
 'fuel_type': 'petrol',
 'id': '05ca66bc-df2e-5491-a0d3-f3425bb202dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7TLT40',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV56308',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 242332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_94bd51caa8b371875e18303ff758cf40.jpg',
                'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_0d9e310c8cabb4e6bbde03c4fb91fb2f.jpg',
                'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_adbdc3a0e25bb46c8f2e785a0b69f3b1.jpg',
                'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_900aeb06a9acfa8bfb62a37dd6f64c42.jpg',
                'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_03fe371cd221ea41f0e479ff72bb8e2d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ca66bc-df2e-5491-a0d3-f3425bb202dd/05ca66bc-df2e-5491-a0d3-f3425bb202dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_94bd51caa8b371875e18303ff758cf40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ca66bc-df2e-5491-a0d3-f3425bb202dd/05ca66bc-df2e-5491-a0d3-f3425bb202dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_0d9e310c8cabb4e6bbde03c4fb91fb2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ca66bc-df2e-5491-a0d3-f3425bb202dd/05ca66bc-df2e-5491-a0d3-f3425bb202dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_adbdc3a0e25bb46c8f2e785a0b69f3b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ca66bc-df2e-5491-a0d3-f3425bb202dd/05ca66bc-df2e-5491-a0d3-f3425bb202dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_900aeb06a9acfa8bfb62a37dd6f64c42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ca66bc-df2e-5491-a0d3-f3425bb202dd/05ca66bc-df2e-5491-a0d3-f3425bb202dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/91/f0915447f906567470f5a95811ad25cd/pa/XV56308_03fe371cd221ea41f0e479ff72bb8e2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV56308%27 HTTP/1.1" 200 None
2026-03-30 12:19:34 [auto1.nl] INFO: Saving data for XV56308: {'created_time': 1774873174.473582, 'last_price_update_time': 1774873174.473592, 'auction_closing_time': 1774969610.0}
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV56308') HTTP/1.1" 204 0
2026-03-30 12:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ19823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC49424/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH78180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ54414> (referer: https://www.auto1.com/v1/car-details-view/NJ54414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e with identifier: NJ54414
2026-03-30 12:19:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e with scrape type 1
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_6e593821142b084287cb25c1a034399d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_6e593821142b084287cb25c1a034399d.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_0e3721852323e90d691a466ccb0988e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_0e3721852323e90d691a466ccb0988e9.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_e504c3aeb35f594afe2b4e8151e81451.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_e504c3aeb35f594afe2b4e8151e81451.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_c2ab5a8b91e633a37653653e2d35be44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_c2ab5a8b91e633a37653653e2d35be44.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_1bce08a8461ca42be9d60aa53d31c185.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_1bce08a8461ca42be9d60aa53d31c185.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_7968538be0670a096eb69606844db278.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_7968538be0670a096eb69606844db278.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_f995cd93583aa0c600b36a092e3055bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_f995cd93583aa0c600b36a092e3055bf.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_74fe803e828b9f57556eae3ba6db4c5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_74fe803e828b9f57556eae3ba6db4c5e.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_8162867f272a63a3fb042d6ea34020da.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_8162867f272a63a3fb042d6ea34020da.jpg already downloaded
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fc4%252F7fc4e0aff395b69782d48d9c9ba6b82f%252Fpa%252FNJ54414_0c739f303af171afe261f376ebaac589.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_0c739f303af171afe261f376ebaac589.jpg already downloaded
2026-03-30 12:19:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e, identifier: NJ54414
2026-03-30 12:19:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e with identifier: NJ54414
2026-03-30 12:19:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e with identifier: NJ54414
2026-03-30 12:19:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e with identifier: NJ54414 to the API
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NJ54414>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:43:58Z',
 'fuel_type': 'petrol',
 'id': '1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '37XNSL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ54414',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 221769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_6e593821142b084287cb25c1a034399d.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_0e3721852323e90d691a466ccb0988e9.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_e504c3aeb35f594afe2b4e8151e81451.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_c2ab5a8b91e633a37653653e2d35be44.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_1bce08a8461ca42be9d60aa53d31c185.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_7968538be0670a096eb69606844db278.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_f995cd93583aa0c600b36a092e3055bf.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_74fe803e828b9f57556eae3ba6db4c5e.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_8162867f272a63a3fb042d6ea34020da.jpg',
                'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_0c739f303af171afe261f376ebaac589.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_6e593821142b084287cb25c1a034399d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_0e3721852323e90d691a466ccb0988e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_e504c3aeb35f594afe2b4e8151e81451.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2832369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_c2ab5a8b91e633a37653653e2d35be44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_1bce08a8461ca42be9d60aa53d31c185.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2897523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_7968538be0670a096eb69606844db278.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2812628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_f995cd93583aa0c600b36a092e3055bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_74fe803e828b9f57556eae3ba6db4c5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2880166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_8162867f272a63a3fb042d6ea34020da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e/1a1fcdc2-6b4d-5cef-8f31-8c73abd2534e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/c4/7fc4e0aff395b69782d48d9c9ba6b82f/pa/NJ54414_0c739f303af171afe261f376ebaac589.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2007}
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ54414%27 HTTP/1.1" 200 None
2026-03-30 12:19:48 [auto1.nl] INFO: Saving data for NJ54414: {'created_time': 1774873188.980037, 'last_price_update_time': 1774873188.980047, 'auction_closing_time': 1774971838.0}
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ54414') HTTP/1.1" 204 0
2026-03-30 12:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT78754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH23479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT18437> (referer: https://www.auto1.com/v1/car-details-view/LT18437/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c with identifier: LT18437
2026-03-30 12:20:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c with scrape type 1
2026-03-30 12:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_0b0af263e018d9b95ca41003b67cd5c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_0b0af263e018d9b95ca41003b67cd5c0.jpg not downloaded yet
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_507a996e1f5b4da17870de5681a89343.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_507a996e1f5b4da17870de5681a89343.jpg not downloaded yet
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_6bce08f0d573b5d472633f50cceb07ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_6bce08f0d573b5d472633f50cceb07ab.jpg not downloaded yet
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_aa2a5b467b72150c3e2d55279d0c6714.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_aa2a5b467b72150c3e2d55279d0c6714.jpg not downloaded yet
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_e19e303b0d652c51fb68394b09a4461c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_e19e303b0d652c51fb68394b09a4461c.jpg not downloaded yet
2026-03-30 12:20:07 [scrapy.extensions.logstats] INFO: Crawled 50 pages (at 13 pages/min), scraped 27 items (at 7 items/min)
2026-03-30 12:20:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 12:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS41016> (referer: https://www.auto1.com/v1/car-details-view/ZS41016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_e19e303b0d652c51fb68394b09a4461c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eab9660-50e8-5f49-96e6-1fcf0e7c4203 with identifier: ZS41016
2026-03-30 12:20:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203 with scrape type 1
2026-03-30 12:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_506baa45b25f7b5ebb75ba1f3dc87566.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_506baa45b25f7b5ebb75ba1f3dc87566.jpg not downloaded yet
2026-03-30 12:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_888007bd57533ce80d1df827935573a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_888007bd57533ce80d1df827935573a0.jpg not downloaded yet
2026-03-30 12:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_aa2a5b467b72150c3e2d55279d0c6714.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_b2af78fd479af74be3435a9f1fb207ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_b2af78fd479af74be3435a9f1fb207ab.jpg not downloaded yet
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_466e02e738dffa67b003d6ddd15aeed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_466e02e738dffa67b003d6ddd15aeed5.jpg not downloaded yet
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_8d62cb478b57ada808054205e414717c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8d62cb478b57ada808054205e414717c.jpg not downloaded yet
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_56ede38e797b034fe4581488239fdf5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_56ede38e797b034fe4581488239fdf5a.jpg not downloaded yet
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69fbf50>
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_e19e303b0d652c51fb68394b09a4461c.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_e19e303b0d652c51fb68394b09a4461c.jpg saved to cache
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ae8250>
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_aa2a5b467b72150c3e2d55279d0c6714.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_aa2a5b467b72150c3e2d55279d0c6714.jpg saved to cache
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_8e0ae9cbc8af1da58577394e16992142.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8e0ae9cbc8af1da58577394e16992142.jpg not downloaded yet
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_e25edd7685cb6bb92e29528947b93050.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_e25edd7685cb6bb92e29528947b93050.jpg not downloaded yet
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_04df81f0bbde756049ab2d3345259048.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_04df81f0bbde756049ab2d3345259048.jpg not downloaded yet
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_d85408ce7908b5c0080f7dae4c1b75d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_d85408ce7908b5c0080f7dae4c1b75d4.jpg not downloaded yet
2026-03-30 12:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_888007bd57533ce80d1df827935573a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f326d0>
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_888007bd57533ce80d1df827935573a0.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_888007bd57533ce80d1df827935573a0.jpg saved to cache
2026-03-30 12:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ24490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_04df81f0bbde756049ab2d3345259048.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6965dd0>
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_04df81f0bbde756049ab2d3345259048.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_04df81f0bbde756049ab2d3345259048.jpg saved to cache
2026-03-30 12:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_d85408ce7908b5c0080f7dae4c1b75d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_e25edd7685cb6bb92e29528947b93050.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d605cc50>
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_d85408ce7908b5c0080f7dae4c1b75d4.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_d85408ce7908b5c0080f7dae4c1b75d4.jpg saved to cache
2026-03-30 12:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a86750>
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_e25edd7685cb6bb92e29528947b93050.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_e25edd7685cb6bb92e29528947b93050.jpg saved to cache
2026-03-30 12:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8e0ae9cbc8af1da58577394e16992142.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_56ede38e797b034fe4581488239fdf5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aeb650>
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_8e0ae9cbc8af1da58577394e16992142.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8e0ae9cbc8af1da58577394e16992142.jpg saved to cache
2026-03-30 12:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60fac90>
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_56ede38e797b034fe4581488239fdf5a.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_56ede38e797b034fe4581488239fdf5a.jpg saved to cache
2026-03-30 12:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY41439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8d62cb478b57ada808054205e414717c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_466e02e738dffa67b003d6ddd15aeed5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60a68d0>
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_8d62cb478b57ada808054205e414717c.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8d62cb478b57ada808054205e414717c.jpg saved to cache
2026-03-30 12:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_506baa45b25f7b5ebb75ba1f3dc87566.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6057f90>
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_466e02e738dffa67b003d6ddd15aeed5.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_466e02e738dffa67b003d6ddd15aeed5.jpg saved to cache
2026-03-30 12:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60a3cd0>
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_506baa45b25f7b5ebb75ba1f3dc87566.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_506baa45b25f7b5ebb75ba1f3dc87566.jpg saved to cache
2026-03-30 12:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_b2af78fd479af74be3435a9f1fb207ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_6bce08f0d573b5d472633f50cceb07ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_507a996e1f5b4da17870de5681a89343.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_0b0af263e018d9b95ca41003b67cd5c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dd114410>
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F89%252F4f89ab8c538aa5f1f54a5566554ee657%252Fpa%252FZS41016_b2af78fd479af74be3435a9f1fb207ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_b2af78fd479af74be3435a9f1fb207ab.jpg saved to cache
2026-03-30 12:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203
2026-03-30 12:20:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1eab9660-50e8-5f49-96e6-1fcf0e7c4203, skipping ID generation
2026-03-30 12:20:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203 with scrape type 1
2026-03-30 12:20:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1eab9660-50e8-5f49-96e6-1fcf0e7c4203 sending to next pipeline
2026-03-30 12:20:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1eab9660-50e8-5f49-96e6-1fcf0e7c4203, identifier: ZS41016
2026-03-30 12:20:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1eab9660-50e8-5f49-96e6-1fcf0e7c4203 with identifier: ZS41016
2026-03-30 12:20:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1eab9660-50e8-5f49-96e6-1fcf0e7c4203 with identifier: ZS41016
2026-03-30 12:20:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1eab9660-50e8-5f49-96e6-1fcf0e7c4203 with identifier: ZS41016 to the API
2026-03-30 12:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_b2af78fd479af74be3435a9f1fb207ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:31:58Z',
 'fuel_type': 'diesel',
 'id': '1eab9660-50e8-5f49-96e6-1fcf0e7c4203',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RK964P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS41016',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 301172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_506baa45b25f7b5ebb75ba1f3dc87566.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931272,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_888007bd57533ce80d1df827935573a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_b2af78fd479af74be3435a9f1fb207ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_466e02e738dffa67b003d6ddd15aeed5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8d62cb478b57ada808054205e414717c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2105310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_56ede38e797b034fe4581488239fdf5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1982302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_8e0ae9cbc8af1da58577394e16992142.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2312742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_e25edd7685cb6bb92e29528947b93050.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_04df81f0bbde756049ab2d3345259048.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eab9660-50e8-5f49-96e6-1fcf0e7c4203/1eab9660-50e8-5f49-96e6-1fcf0e7c4203_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/89/4f89ab8c538aa5f1f54a5566554ee657/pa/ZS41016_d85408ce7908b5c0080f7dae4c1b75d4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI T 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'T 4Matic BlueEfficiency',
 'year': 2010}
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS41016%27 HTTP/1.1" 200 None
2026-03-30 12:20:13 [auto1.nl] INFO: Saving data for ZS41016: {'created_time': 1774873213.150401, 'last_price_update_time': 1774873213.150411, 'auction_closing_time': 1774971118.0}
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZS41016') HTTP/1.1" 204 0
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f2bb10>
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_6bce08f0d573b5d472633f50cceb07ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_6bce08f0d573b5d472633f50cceb07ab.jpg saved to cache
2026-03-30 12:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbc4a10>
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_507a996e1f5b4da17870de5681a89343.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_507a996e1f5b4da17870de5681a89343.jpg saved to cache
2026-03-30 12:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f1cf90>
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fef%252F5bef75f2002de1e137a6e5aaad028ddb%252Fpa%252FLT18437_0b0af263e018d9b95ca41003b67cd5c0.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_0b0af263e018d9b95ca41003b67cd5c0.jpg saved to cache
2026-03-30 12:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c
2026-03-30 12:20:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c, skipping ID generation
2026-03-30 12:20:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c with scrape type 1
2026-03-30 12:20:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c sending to next pipeline
2026-03-30 12:20:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c, identifier: LT18437
2026-03-30 12:20:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c with identifier: LT18437
2026-03-30 12:20:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c with identifier: LT18437
2026-03-30 12:20:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c with identifier: LT18437 to the API
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_0b0af263e018d9b95ca41003b67cd5c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:51:17Z',
 'fuel_type': 'petrol',
 'id': '1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '63-NN-ZV',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT18437',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 217622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_0b0af263e018d9b95ca41003b67cd5c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_507a996e1f5b4da17870de5681a89343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_6bce08f0d573b5d472633f50cceb07ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_aa2a5b467b72150c3e2d55279d0c6714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c/1f2540e4-1f89-50d1-a1dd-c87c1fa1a86c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ef/5bef75f2002de1e137a6e5aaad028ddb/pa/LT18437_e19e303b0d652c51fb68394b09a4461c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-01-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2004}
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT18437%27 HTTP/1.1" 200 None
2026-03-30 12:20:13 [auto1.nl] INFO: Saving data for LT18437: {'created_time': 1774873213.769031, 'last_price_update_time': 1774873213.769041, 'auction_closing_time': 1774972277.0}
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT18437') HTTP/1.1" 204 0
2026-03-30 12:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH64260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ19823> (referer: https://www.auto1.com/v1/car-details-view/JJ19823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73de8555-7488-56ab-92e2-91ab8410c3e8 with identifier: JJ19823
2026-03-30 12:20:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73de8555-7488-56ab-92e2-91ab8410c3e8 with scrape type 1
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_68b9d42a22b705f486c334327462ed4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_68b9d42a22b705f486c334327462ed4b.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_e7d2d600c53f09ff3a6c8b5e9a860bc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_e7d2d600c53f09ff3a6c8b5e9a860bc2.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_29673fdd95f8d75826bd2d924f321928.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_29673fdd95f8d75826bd2d924f321928.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_f3b3c69f0327e61d4599c9e2f2d056a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_f3b3c69f0327e61d4599c9e2f2d056a5.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_baf60d243174886a3508c38a513ff776.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_baf60d243174886a3508c38a513ff776.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_ff832eebf0e97383f9d564ca925896b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_ff832eebf0e97383f9d564ca925896b4.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_da939f8efa6bdffdf191deca57e3b961.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_da939f8efa6bdffdf191deca57e3b961.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_596a3a4e21ddc84236b27ba1b159c382.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_596a3a4e21ddc84236b27ba1b159c382.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_a5afc7ab3f00ed687c9b452f11593652.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_a5afc7ab3f00ed687c9b452f11593652.jpg not downloaded yet
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_3deb0d676a77346b09ddad538bc75ab5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_3deb0d676a77346b09ddad538bc75ab5.jpg not downloaded yet
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH78180> (referer: https://www.auto1.com/v1/car-details-view/VH78180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_3deb0d676a77346b09ddad538bc75ab5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c041ba5-288a-550a-a9c9-ad23358c71da with identifier: VH78180
2026-03-30 12:20:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c041ba5-288a-550a-a9c9-ad23358c71da with scrape type 1
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c041ba5-288a-550a-a9c9-ad23358c71da
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_cb915744b1ad717444f754fa6945e699.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_cb915744b1ad717444f754fa6945e699.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_692474143d0a1ab551820a3085d7f119.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_692474143d0a1ab551820a3085d7f119.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_a506f6c1c0634191197a7254d4291dd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_a506f6c1c0634191197a7254d4291dd6.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_aead71cebc02f9f6c4c1e448213b61c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_aead71cebc02f9f6c4c1e448213b61c8.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_d01818cbe1187a149c697ba2aafbb5c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_d01818cbe1187a149c697ba2aafbb5c7.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_c32f9ad36cdc4a7e2eeecf6f46dc9bdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_c32f9ad36cdc4a7e2eeecf6f46dc9bdc.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_df771d0df2fea5ffadd4f6c894f3f93e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_df771d0df2fea5ffadd4f6c894f3f93e.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_a961e17b29a4afd7eae55109368a06ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_a961e17b29a4afd7eae55109368a06ef.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_20f9ec75852c694397642c1f0305a9cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_20f9ec75852c694397642c1f0305a9cb.jpg already downloaded
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fa1%252F04a151072cde8a2c2765ae1e42905387%252Fpa%252FVH78180_6989332721a3b242ff7ff146316200ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_6989332721a3b242ff7ff146316200ff.jpg already downloaded
2026-03-30 12:20:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2c041ba5-288a-550a-a9c9-ad23358c71da, identifier: VH78180
2026-03-30 12:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2c041ba5-288a-550a-a9c9-ad23358c71da with identifier: VH78180
2026-03-30 12:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2c041ba5-288a-550a-a9c9-ad23358c71da with identifier: VH78180
2026-03-30 12:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2c041ba5-288a-550a-a9c9-ad23358c71da with identifier: VH78180 to the API
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH78180>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:21:52Z',
 'fuel_type': 'petrol',
 'id': '2c041ba5-288a-550a-a9c9-ad23358c71da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K462ZT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH78180',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 167806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_cb915744b1ad717444f754fa6945e699.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_692474143d0a1ab551820a3085d7f119.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_a506f6c1c0634191197a7254d4291dd6.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_aead71cebc02f9f6c4c1e448213b61c8.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_d01818cbe1187a149c697ba2aafbb5c7.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_c32f9ad36cdc4a7e2eeecf6f46dc9bdc.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_df771d0df2fea5ffadd4f6c894f3f93e.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_a961e17b29a4afd7eae55109368a06ef.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_20f9ec75852c694397642c1f0305a9cb.jpg',
                'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_6989332721a3b242ff7ff146316200ff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3521524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_cb915744b1ad717444f754fa6945e699.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_692474143d0a1ab551820a3085d7f119.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3020629,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_a506f6c1c0634191197a7254d4291dd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2867296,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_aead71cebc02f9f6c4c1e448213b61c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3297734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_d01818cbe1187a149c697ba2aafbb5c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_c32f9ad36cdc4a7e2eeecf6f46dc9bdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_df771d0df2fea5ffadd4f6c894f3f93e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_a961e17b29a4afd7eae55109368a06ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3450233,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_20f9ec75852c694397642c1f0305a9cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c041ba5-288a-550a-a9c9-ad23358c71da/2c041ba5-288a-550a-a9c9-ad23358c71da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/a1/04a151072cde8a2c2765ae1e42905387/pa/VH78180_6989332721a3b242ff7ff146316200ff.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI e-TEC Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH78180%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.nl] INFO: Saving data for VH78180: {'created_time': 1774873231.771373, 'last_price_update_time': 1774873231.771383, 'auction_closing_time': 1774970512.0}
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH78180') HTTP/1.1" 204 0
2026-03-30 12:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_a5afc7ab3f00ed687c9b452f11593652.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ab4e90>
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_3deb0d676a77346b09ddad538bc75ab5.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_3deb0d676a77346b09ddad538bc75ab5.jpg saved to cache
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_596a3a4e21ddc84236b27ba1b159c382.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603d450>
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_a5afc7ab3f00ed687c9b452f11593652.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_a5afc7ab3f00ed687c9b452f11593652.jpg saved to cache
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_da939f8efa6bdffdf191deca57e3b961.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a4f610>
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_596a3a4e21ddc84236b27ba1b159c382.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_596a3a4e21ddc84236b27ba1b159c382.jpg saved to cache
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dd114190>
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_da939f8efa6bdffdf191deca57e3b961.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_da939f8efa6bdffdf191deca57e3b961.jpg saved to cache
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_ff832eebf0e97383f9d564ca925896b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f2cfd0>
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_ff832eebf0e97383f9d564ca925896b4.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_ff832eebf0e97383f9d564ca925896b4.jpg saved to cache
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_baf60d243174886a3508c38a513ff776.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a89a50>
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_baf60d243174886a3508c38a513ff776.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_baf60d243174886a3508c38a513ff776.jpg saved to cache
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_f3b3c69f0327e61d4599c9e2f2d056a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f073d0>
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_f3b3c69f0327e61d4599c9e2f2d056a5.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_f3b3c69f0327e61d4599c9e2f2d056a5.jpg saved to cache
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_29673fdd95f8d75826bd2d924f321928.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60f5290>
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_29673fdd95f8d75826bd2d924f321928.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_29673fdd95f8d75826bd2d924f321928.jpg saved to cache
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_e7d2d600c53f09ff3a6c8b5e9a860bc2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF31929> (referer: https://www.auto1.com/v1/car-details-view/XF31929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_68b9d42a22b705f486c334327462ed4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d696a390>
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_e7d2d600c53f09ff3a6c8b5e9a860bc2.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_e7d2d600c53f09ff3a6c8b5e9a860bc2.jpg saved to cache
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df538c1-a1e6-567c-b587-942a75bf819c with identifier: XF31929
2026-03-30 12:20:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df538c1-a1e6-567c-b587-942a75bf819c with scrape type 1
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9df538c1-a1e6-567c-b587-942a75bf819c
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_c16836744b4d3ea2d8c73d426c2c28cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_c16836744b4d3ea2d8c73d426c2c28cd.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_a97e79f16bac3bc8572c91a3eb66ee7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_a97e79f16bac3bc8572c91a3eb66ee7c.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_024e227e6f43e98a5efb72130f1ee0cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_024e227e6f43e98a5efb72130f1ee0cf.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_05c7d7a11092eef16c07a22a22b2a78b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_05c7d7a11092eef16c07a22a22b2a78b.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_1982e78d8f7f65a6376dd027cebe5990.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_1982e78d8f7f65a6376dd027cebe5990.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_34b74b22f3562985b217dec27e81b029.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_34b74b22f3562985b217dec27e81b029.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_7e664f459e4fe8d7663ec9837312afa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_7e664f459e4fe8d7663ec9837312afa7.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_90f109107b5ecd6551c2c515a8a99841.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_90f109107b5ecd6551c2c515a8a99841.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_863d74fbb144a828206b3a1d59b7f6ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_863d74fbb144a828206b3a1d59b7f6ec.jpg already downloaded
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fad%252F89ad6b148490d9f49639eba8362a114f%252Fpa%252FXF31929_d927bc0f60875c3b58c8b8f9e6563182.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_d927bc0f60875c3b58c8b8f9e6563182.jpg already downloaded
2026-03-30 12:20:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9df538c1-a1e6-567c-b587-942a75bf819c, identifier: XF31929
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6948d50>
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fb3%252F73b3a0bafd34aa7618df2ede716c2208%252Fpa%252FJJ19823_68b9d42a22b705f486c334327462ed4b.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_68b9d42a22b705f486c334327462ed4b.jpg saved to cache
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73de8555-7488-56ab-92e2-91ab8410c3e8
2026-03-30 12:20:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73de8555-7488-56ab-92e2-91ab8410c3e8, skipping ID generation
2026-03-30 12:20:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73de8555-7488-56ab-92e2-91ab8410c3e8 with scrape type 1
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73de8555-7488-56ab-92e2-91ab8410c3e8 sending to next pipeline
2026-03-30 12:20:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73de8555-7488-56ab-92e2-91ab8410c3e8, identifier: JJ19823
2026-03-30 12:20:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9df538c1-a1e6-567c-b587-942a75bf819c with identifier: XF31929
2026-03-30 12:20:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9df538c1-a1e6-567c-b587-942a75bf819c with identifier: XF31929
2026-03-30 12:20:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9df538c1-a1e6-567c-b587-942a75bf819c with identifier: XF31929 to the API
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XF31929>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:17:54Z',
 'fuel_type': 'petrol',
 'id': '9df538c1-a1e6-567c-b587-942a75bf819c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K-584-GB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF31929',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 219243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_c16836744b4d3ea2d8c73d426c2c28cd.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_a97e79f16bac3bc8572c91a3eb66ee7c.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_024e227e6f43e98a5efb72130f1ee0cf.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_05c7d7a11092eef16c07a22a22b2a78b.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_1982e78d8f7f65a6376dd027cebe5990.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_34b74b22f3562985b217dec27e81b029.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_7e664f459e4fe8d7663ec9837312afa7.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_90f109107b5ecd6551c2c515a8a99841.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_863d74fbb144a828206b3a1d59b7f6ec.jpg',
                'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_d927bc0f60875c3b58c8b8f9e6563182.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_c16836744b4d3ea2d8c73d426c2c28cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_a97e79f16bac3bc8572c91a3eb66ee7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_024e227e6f43e98a5efb72130f1ee0cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_05c7d7a11092eef16c07a22a22b2a78b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_1982e78d8f7f65a6376dd027cebe5990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_34b74b22f3562985b217dec27e81b029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_7e664f459e4fe8d7663ec9837312afa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_90f109107b5ecd6551c2c515a8a99841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_863d74fbb144a828206b3a1d59b7f6ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df538c1-a1e6-567c-b587-942a75bf819c/9df538c1-a1e6-567c-b587-942a75bf819c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/ad/89ad6b148490d9f49639eba8362a114f/pa/XF31929_d927bc0f60875c3b58c8b8f9e6563182.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'automatic',
 'trim': 'Coupe',
 'year': 2009}
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF31929%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [auto1.nl] INFO: Saving data for XF31929: {'created_time': 1774873233.863916, 'last_price_update_time': 1774873233.863927, 'auction_closing_time': 1774970274.0}
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XF31929') HTTP/1.1" 204 0
2026-03-30 12:20:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73de8555-7488-56ab-92e2-91ab8410c3e8 with identifier: JJ19823
2026-03-30 12:20:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73de8555-7488-56ab-92e2-91ab8410c3e8 with identifier: JJ19823
2026-03-30 12:20:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73de8555-7488-56ab-92e2-91ab8410c3e8 with identifier: JJ19823 to the API
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_68b9d42a22b705f486c334327462ed4b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:30Z',
 'fuel_type': 'diesel',
 'id': '73de8555-7488-56ab-92e2-91ab8410c3e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ19823',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 159468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_68b9d42a22b705f486c334327462ed4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_e7d2d600c53f09ff3a6c8b5e9a860bc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_29673fdd95f8d75826bd2d924f321928.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_f3b3c69f0327e61d4599c9e2f2d056a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_baf60d243174886a3508c38a513ff776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_ff832eebf0e97383f9d564ca925896b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_da939f8efa6bdffdf191deca57e3b961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_596a3a4e21ddc84236b27ba1b159c382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_a5afc7ab3f00ed687c9b452f11593652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de8555-7488-56ab-92e2-91ab8410c3e8/73de8555-7488-56ab-92e2-91ab8410c3e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/b3/73b3a0bafd34aa7618df2ede716c2208/pa/JJ19823_3deb0d676a77346b09ddad538bc75ab5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2017}
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ19823%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [auto1.nl] INFO: Saving data for JJ19823: {'created_time': 1774873234.249923, 'last_price_update_time': 1774873234.249933, 'auction_closing_time': 1774969470.0}
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JJ19823') HTTP/1.1" 204 0
2026-03-30 12:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC49424> (referer: https://www.auto1.com/v1/car-details-view/GC49424/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe0c234-514e-58b3-b6ed-e78fd808a95a with identifier: GC49424
2026-03-30 12:20:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe0c234-514e-58b3-b6ed-e78fd808a95a with scrape type 1
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_1b7121959e7679c24ddfa119c8fa1525.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_1b7121959e7679c24ddfa119c8fa1525.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_cc6c2d56602d6e3eec8a1fb3350fd179.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_cc6c2d56602d6e3eec8a1fb3350fd179.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_3e8c9b9929e86655ec5e9e6d96ed7a69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_3e8c9b9929e86655ec5e9e6d96ed7a69.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_5b1f1c57957040355d2af4970d44cbb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_5b1f1c57957040355d2af4970d44cbb8.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_da6d47dd285e36c48434e3208faf9845.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_da6d47dd285e36c48434e3208faf9845.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_e2bdf2de92dac8e3fc09d70d11bb2c78.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_e2bdf2de92dac8e3fc09d70d11bb2c78.jpg not downloaded yet
2026-03-30 12:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_ffbdecf8a3928f6345fe76155a84012f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_7164e09aff34247e57b1633d61e2d09b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_7164e09aff34247e57b1633d61e2d09b.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_4ed6c2021d78be13ceb91dac45228ed2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_4ed6c2021d78be13ceb91dac45228ed2.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_ec00151f4170e770a7accd17a5255d21.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_ec00151f4170e770a7accd17a5255d21.jpg not downloaded yet
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_6d25f0e4c527d35d1c73164b017ec738.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_6d25f0e4c527d35d1c73164b017ec738.jpg not downloaded yet
2026-03-30 12:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_e2bdf2de92dac8e3fc09d70d11bb2c78.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60cd9d0>
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_ffbdecf8a3928f6345fe76155a84012f.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_ffbdecf8a3928f6345fe76155a84012f.jpg saved to cache
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_6d25f0e4c527d35d1c73164b017ec738.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6964850>
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_e2bdf2de92dac8e3fc09d70d11bb2c78.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_e2bdf2de92dac8e3fc09d70d11bb2c78.jpg saved to cache
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_ec00151f4170e770a7accd17a5255d21.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc958490>
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_6d25f0e4c527d35d1c73164b017ec738.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_6d25f0e4c527d35d1c73164b017ec738.jpg saved to cache
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_4ed6c2021d78be13ceb91dac45228ed2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_7164e09aff34247e57b1633d61e2d09b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60cc750>
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_ec00151f4170e770a7accd17a5255d21.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_ec00151f4170e770a7accd17a5255d21.jpg saved to cache
2026-03-30 12:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60b9a50>
2026-03-30 12:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_4ed6c2021d78be13ceb91dac45228ed2.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_4ed6c2021d78be13ceb91dac45228ed2.jpg saved to cache
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_da6d47dd285e36c48434e3208faf9845.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60405d0>
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_7164e09aff34247e57b1633d61e2d09b.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_7164e09aff34247e57b1633d61e2d09b.jpg saved to cache
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_5b1f1c57957040355d2af4970d44cbb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_3e8c9b9929e86655ec5e9e6d96ed7a69.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6926650>
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_da6d47dd285e36c48434e3208faf9845.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_da6d47dd285e36c48434e3208faf9845.jpg saved to cache
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_cc6c2d56602d6e3eec8a1fb3350fd179.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69fb950>
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_5b1f1c57957040355d2af4970d44cbb8.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_5b1f1c57957040355d2af4970d44cbb8.jpg saved to cache
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:35 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14835685) larger than download warn size (10485760) in request <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_1b7121959e7679c24ddfa119c8fa1525.jpg>.
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6050610>
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_3e8c9b9929e86655ec5e9e6d96ed7a69.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_3e8c9b9929e86655ec5e9e6d96ed7a69.jpg saved to cache
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ15227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d77404d0>
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_cc6c2d56602d6e3eec8a1fb3350fd179.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_cc6c2d56602d6e3eec8a1fb3350fd179.jpg saved to cache
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_d8faf587a713e5ac26c895ec6e41b516.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6096250>
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_d8faf587a713e5ac26c895ec6e41b516.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_d8faf587a713e5ac26c895ec6e41b516.jpg saved to cache
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:36 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_1b7121959e7679c24ddfa119c8fa1525.jpg>.
2026-03-30 12:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_1b7121959e7679c24ddfa119c8fa1525.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:20:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:20:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:20:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:20:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6095290>
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F52%252Ff752f7d8613d22b1d55a50b977c30e24%252Fpa%252FGC49424_1b7121959e7679c24ddfa119c8fa1525.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_1b7121959e7679c24ddfa119c8fa1525.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfe0c234-514e-58b3-b6ed-e78fd808a95a
2026-03-30 12:20:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfe0c234-514e-58b3-b6ed-e78fd808a95a, skipping ID generation
2026-03-30 12:20:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe0c234-514e-58b3-b6ed-e78fd808a95a with scrape type 1
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfe0c234-514e-58b3-b6ed-e78fd808a95a sending to next pipeline
2026-03-30 12:20:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bfe0c234-514e-58b3-b6ed-e78fd808a95a, identifier: GC49424
2026-03-30 12:20:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bfe0c234-514e-58b3-b6ed-e78fd808a95a with identifier: GC49424
2026-03-30 12:20:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bfe0c234-514e-58b3-b6ed-e78fd808a95a with identifier: GC49424
2026-03-30 12:20:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bfe0c234-514e-58b3-b6ed-e78fd808a95a with identifier: GC49424 to the API
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_1b7121959e7679c24ddfa119c8fa1525.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:41:40Z',
 'fuel_type': 'petrol',
 'id': 'bfe0c234-514e-58b3-b6ed-e78fd808a95a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC49424',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 101440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 14835685,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_1b7121959e7679c24ddfa119c8fa1525.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_cc6c2d56602d6e3eec8a1fb3350fd179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_3e8c9b9929e86655ec5e9e6d96ed7a69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_5b1f1c57957040355d2af4970d44cbb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_da6d47dd285e36c48434e3208faf9845.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_e2bdf2de92dac8e3fc09d70d11bb2c78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_7164e09aff34247e57b1633d61e2d09b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_4ed6c2021d78be13ceb91dac45228ed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_ec00151f4170e770a7accd17a5255d21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe0c234-514e-58b3-b6ed-e78fd808a95a/bfe0c234-514e-58b3-b6ed-e78fd808a95a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/52/f752f7d8613d22b1d55a50b977c30e24/pa/GC49424_6d25f0e4c527d35d1c73164b017ec738.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2019}
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC49424%27 HTTP/1.1" 200 None
2026-03-30 12:20:37 [auto1.nl] INFO: Saving data for GC49424: {'created_time': 1774873237.855873, 'last_price_update_time': 1774873237.855885, 'auction_closing_time': 1774971700.0}
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GC49424') HTTP/1.1" 204 0
2026-03-30 12:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_027a9e81521743ff067626b4cb0fd713.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60cc990>
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_027a9e81521743ff067626b4cb0fd713.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_027a9e81521743ff067626b4cb0fd713.jpg saved to cache
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_edc940e4338cd0e3de81a10a481bfe66.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6096250>
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_edc940e4338cd0e3de81a10a481bfe66.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_edc940e4338cd0e3de81a10a481bfe66.jpg saved to cache
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_fd05c5fdcc0b4ac516b6b669013bfbce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d693c550>
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_fd05c5fdcc0b4ac516b6b669013bfbce.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_fd05c5fdcc0b4ac516b6b669013bfbce.jpg saved to cache
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_1c5a198e8f71ac2b4f5b386a44f11517.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT78754> (referer: https://www.auto1.com/v1/car-details-view/DT78754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f1db50>
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_1c5a198e8f71ac2b4f5b386a44f11517.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_1c5a198e8f71ac2b4f5b386a44f11517.jpg saved to cache
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05e1f4c0-8979-552b-804e-9ddc0f508faf with identifier: DT78754
2026-03-30 12:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05e1f4c0-8979-552b-804e-9ddc0f508faf with scrape type 1
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 05e1f4c0-8979-552b-804e-9ddc0f508faf
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F16%252Ff3165893d3b4c70b388d36c6e33ead8f%252Fpa%252FDT78754_2919e68b5241960cc19b2b55430a196b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_2919e68b5241960cc19b2b55430a196b.jpg already downloaded
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F16%252Ff3165893d3b4c70b388d36c6e33ead8f%252Fpa%252FDT78754_0aa3e72511653d1541e5fe59b008f82d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_0aa3e72511653d1541e5fe59b008f82d.jpg already downloaded
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F16%252Ff3165893d3b4c70b388d36c6e33ead8f%252Fpa%252FDT78754_976a1b1c35421bb0a118dcfc936e973f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_976a1b1c35421bb0a118dcfc936e973f.jpg already downloaded
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F16%252Ff3165893d3b4c70b388d36c6e33ead8f%252Fpa%252FDT78754_1dd9b03d76f226be5f95c4c81f36663c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_1dd9b03d76f226be5f95c4c81f36663c.jpg already downloaded
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F16%252Ff3165893d3b4c70b388d36c6e33ead8f%252Fpa%252FDT78754_4c883da94c52454931b0e84e24865731.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_4c883da94c52454931b0e84e24865731.jpg already downloaded
2026-03-30 12:20:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 05e1f4c0-8979-552b-804e-9ddc0f508faf, identifier: DT78754
2026-03-30 12:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 05e1f4c0-8979-552b-804e-9ddc0f508faf with identifier: DT78754
2026-03-30 12:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 05e1f4c0-8979-552b-804e-9ddc0f508faf with identifier: DT78754
2026-03-30 12:20:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 05e1f4c0-8979-552b-804e-9ddc0f508faf with identifier: DT78754 to the API
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT78754>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:26:17Z',
 'fuel_type': 'diesel',
 'id': '05e1f4c0-8979-552b-804e-9ddc0f508faf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '6VLT61',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT78754',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 212626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_2919e68b5241960cc19b2b55430a196b.jpg',
                'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_0aa3e72511653d1541e5fe59b008f82d.jpg',
                'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_976a1b1c35421bb0a118dcfc936e973f.jpg',
                'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_1dd9b03d76f226be5f95c4c81f36663c.jpg',
                'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_4c883da94c52454931b0e84e24865731.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e1f4c0-8979-552b-804e-9ddc0f508faf/05e1f4c0-8979-552b-804e-9ddc0f508faf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_2919e68b5241960cc19b2b55430a196b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e1f4c0-8979-552b-804e-9ddc0f508faf/05e1f4c0-8979-552b-804e-9ddc0f508faf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_0aa3e72511653d1541e5fe59b008f82d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e1f4c0-8979-552b-804e-9ddc0f508faf/05e1f4c0-8979-552b-804e-9ddc0f508faf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_976a1b1c35421bb0a118dcfc936e973f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e1f4c0-8979-552b-804e-9ddc0f508faf/05e1f4c0-8979-552b-804e-9ddc0f508faf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_1dd9b03d76f226be5f95c4c81f36663c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e1f4c0-8979-552b-804e-9ddc0f508faf/05e1f4c0-8979-552b-804e-9ddc0f508faf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/16/f3165893d3b4c70b388d36c6e33ead8f/pa/DT78754_4c883da94c52454931b0e84e24865731.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Kasten Comfort',
 'transmission': 'manual',
 'trim': 'Kasten Comfort',
 'year': 2011}
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT78754%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Saving data for DT78754: {'created_time': 1774873239.38243, 'last_price_update_time': 1774873239.382441, 'auction_closing_time': 1774970777.0}
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT78754') HTTP/1.1" 204 0
2026-03-30 12:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_350d00c923a1a5601ac21ac74f3b1543.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_f84c1aed044913e138154f2f6485fab8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_dfad601e1ca602af3498853b089e0dc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c4fd0>
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_350d00c923a1a5601ac21ac74f3b1543.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_350d00c923a1a5601ac21ac74f3b1543.jpg saved to cache
2026-03-30 12:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60f5790>
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_f84c1aed044913e138154f2f6485fab8.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_f84c1aed044913e138154f2f6485fab8.jpg saved to cache
2026-03-30 12:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aa1d50>
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fcd%252F1bcd845dcc9544eb8c87fdf74e51adef%252Fpa%252FVK82008_dfad601e1ca602af3498853b089e0dc3.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_dfad601e1ca602af3498853b089e0dc3.jpg saved to cache
2026-03-30 12:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a
2026-03-30 12:20:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e626ed0-42af-5384-8aa8-c9b0374e8e5a, skipping ID generation
2026-03-30 12:20:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a with scrape type 1
2026-03-30 12:20:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e626ed0-42af-5384-8aa8-c9b0374e8e5a sending to next pipeline
2026-03-30 12:20:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6e626ed0-42af-5384-8aa8-c9b0374e8e5a, identifier: VK82008
2026-03-30 12:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6e626ed0-42af-5384-8aa8-c9b0374e8e5a with identifier: VK82008
2026-03-30 12:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6e626ed0-42af-5384-8aa8-c9b0374e8e5a with identifier: VK82008
2026-03-30 12:20:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6e626ed0-42af-5384-8aa8-c9b0374e8e5a with identifier: VK82008 to the API
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_dfad601e1ca602af3498853b089e0dc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:22:40Z',
 'fuel_type': 'petrol',
 'id': '6e626ed0-42af-5384-8aa8-c9b0374e8e5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XH170D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK82008',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 91787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_dfad601e1ca602af3498853b089e0dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_f84c1aed044913e138154f2f6485fab8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_350d00c923a1a5601ac21ac74f3b1543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_1c5a198e8f71ac2b4f5b386a44f11517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_fd05c5fdcc0b4ac516b6b669013bfbce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_edc940e4338cd0e3de81a10a481bfe66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_027a9e81521743ff067626b4cb0fd713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_d8faf587a713e5ac26c895ec6e41b516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_ffbdecf8a3928f6345fe76155a84012f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e626ed0-42af-5384-8aa8-c9b0374e8e5a/6e626ed0-42af-5384-8aa8-c9b0374e8e5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/cd/1bcd845dcc9544eb8c87fdf74e51adef/pa/VK82008_a62e3f0e61ac11c638e149068c2aadcd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-30 12:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK82008%27 HTTP/1.1" 200 None
2026-03-30 12:20:40 [auto1.nl] INFO: Saving data for VK82008: {'created_time': 1774873240.19449, 'last_price_update_time': 1774873240.1945, 'auction_closing_time': 1774970560.0}
2026-03-30 12:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VK82008') HTTP/1.1" 204 0
2026-03-30 12:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH23479> (referer: https://www.auto1.com/v1/car-details-view/TH23479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907 with identifier: TH23479
2026-03-30 12:20:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907 with scrape type 1
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_e4edeb0409a2145130aa2b64151b27d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_e4edeb0409a2145130aa2b64151b27d6.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_cda013934086e88f6b59a439a1e15632.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_cda013934086e88f6b59a439a1e15632.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_f5276d0e2f4c8fc1224d9e54e83521fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_f5276d0e2f4c8fc1224d9e54e83521fc.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_c7765d660141c9fb29cbe3524a23e383.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_c7765d660141c9fb29cbe3524a23e383.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_22be244106d649d2f8b87f49325e2a72.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_22be244106d649d2f8b87f49325e2a72.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_c6bc6a4df1d79d1b92cbae2d8a79bb9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_c6bc6a4df1d79d1b92cbae2d8a79bb9b.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_3fb7907f3ac42307fd51a06f505383dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_3fb7907f3ac42307fd51a06f505383dd.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_a89273276d3c6d348c6822af846af424.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_a89273276d3c6d348c6822af846af424.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_8768127e679aa432f7d257a41b820935.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_8768127e679aa432f7d257a41b820935.jpg already downloaded
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F53%252F2053dee83a8720c12b9f6239701a4c45%252Fpa%252FTH23479_afe989c55d0baeff83e01c3c697c7942.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_afe989c55d0baeff83e01c3c697c7942.jpg already downloaded
2026-03-30 12:20:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907, identifier: TH23479
2026-03-30 12:20:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907 with identifier: TH23479
2026-03-30 12:20:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907 with identifier: TH23479
2026-03-30 12:20:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907 with identifier: TH23479 to the API
2026-03-30 12:20:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH23479>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:22:43Z',
 'fuel_type': 'diesel',
 'id': 'a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'Vt825k',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH23479',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 114999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_e4edeb0409a2145130aa2b64151b27d6.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_cda013934086e88f6b59a439a1e15632.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_f5276d0e2f4c8fc1224d9e54e83521fc.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_c7765d660141c9fb29cbe3524a23e383.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_22be244106d649d2f8b87f49325e2a72.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_c6bc6a4df1d79d1b92cbae2d8a79bb9b.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_3fb7907f3ac42307fd51a06f505383dd.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_a89273276d3c6d348c6822af846af424.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_8768127e679aa432f7d257a41b820935.jpg',
                'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_afe989c55d0baeff83e01c3c697c7942.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_e4edeb0409a2145130aa2b64151b27d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_cda013934086e88f6b59a439a1e15632.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_f5276d0e2f4c8fc1224d9e54e83521fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_c7765d660141c9fb29cbe3524a23e383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_22be244106d649d2f8b87f49325e2a72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_c6bc6a4df1d79d1b92cbae2d8a79bb9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_3fb7907f3ac42307fd51a06f505383dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_a89273276d3c6d348c6822af846af424.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_8768127e679aa432f7d257a41b820935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907/a71a4c1e-1f02-54ab-a8ae-ff6cba5e0907_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3128847,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/53/2053dee83a8720c12b9f6239701a4c45/pa/TH23479_afe989c55d0baeff83e01c3c697c7942.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy Grand Confort L2H1 1200',
 'transmission': 'manual',
 'trim': 'Grand Confort L2H1 1200',
 'year': 2016}
2026-03-30 12:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH23479%27 HTTP/1.1" 200 None
2026-03-30 12:20:43 [auto1.nl] INFO: Saving data for TH23479: {'created_time': 1774873243.418938, 'last_price_update_time': 1774873243.418948, 'auction_closing_time': 1774970563.0}
2026-03-30 12:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TH23479') HTTP/1.1" 204 0
2026-03-30 12:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL79212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW70134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.124(s), this was the 1st time calling it.
2026-03-30 12:20:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.843737061894392 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU60882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH64260> (referer: https://www.auto1.com/v1/car-details-view/HH64260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba with identifier: HH64260
2026-03-30 12:21:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba with scrape type 1
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_95e9341b2cc2cc560cbbfc257400d1bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_95e9341b2cc2cc560cbbfc257400d1bb.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_0ffeec71ee504fde37a966cc8903b7e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_0ffeec71ee504fde37a966cc8903b7e8.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_73286643dd22ef4278b2ddd6bb949c7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_73286643dd22ef4278b2ddd6bb949c7e.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_b6ae9bb3084105c454106a5a0c91bfe1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_b6ae9bb3084105c454106a5a0c91bfe1.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_ede4d8915636d896b040b63269dd5fd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_ede4d8915636d896b040b63269dd5fd0.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_d803d8eac0e509285ffa0c88f459f575.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_d803d8eac0e509285ffa0c88f459f575.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_5e6ec19bbe832717b5e13a5c3880048c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_5e6ec19bbe832717b5e13a5c3880048c.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_89f2f0a7b298eb7c8d14714e1fa852bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_89f2f0a7b298eb7c8d14714e1fa852bc.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_c85b5d03575dffc871fab3a2459b0ea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_c85b5d03575dffc871fab3a2459b0ea6.jpg not downloaded yet
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_3b7508bf450f776de7cafe569d6de811.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_3b7508bf450f776de7cafe569d6de811.jpg not downloaded yet
2026-03-30 12:21:07 [scrapy.extensions.logstats] INFO: Crawled 65 pages (at 15 pages/min), scraped 36 items (at 9 items/min)
2026-03-30 12:21:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT64280/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_3b7508bf450f776de7cafe569d6de811.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d605d290>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_3b7508bf450f776de7cafe569d6de811.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_3b7508bf450f776de7cafe569d6de811.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY41439> (referer: https://www.auto1.com/v1/car-details-view/WY41439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267d9a4a-2005-5b22-abb0-f7ce5795eb53 with identifier: WY41439
2026-03-30 12:21:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53 with scrape type 1
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_ccab924cfee4850526f74d4fc9641f31.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_ccab924cfee4850526f74d4fc9641f31.jpg not downloaded yet
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_280c1942790eca79887759b23939bf61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_280c1942790eca79887759b23939bf61.jpg not downloaded yet
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_b0abb0a005244ca7095ba339f0efce5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_b0abb0a005244ca7095ba339f0efce5a.jpg not downloaded yet
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_014d8093f1f8eda6ff7b8a30e6368780.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_014d8093f1f8eda6ff7b8a30e6368780.jpg not downloaded yet
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_bff6c8a8bd9709aa00805918dc8fe906.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_bff6c8a8bd9709aa00805918dc8fe906.jpg not downloaded yet
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_c6279e580852621aa5bc0370ed843490.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_c6279e580852621aa5bc0370ed843490.jpg not downloaded yet
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_c85b5d03575dffc871fab3a2459b0ea6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_c6279e580852621aa5bc0370ed843490.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_bff6c8a8bd9709aa00805918dc8fe906.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d602b7d0>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_c85b5d03575dffc871fab3a2459b0ea6.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_c85b5d03575dffc871fab3a2459b0ea6.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_014d8093f1f8eda6ff7b8a30e6368780.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6043a50>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_c6279e580852621aa5bc0370ed843490.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_c6279e580852621aa5bc0370ed843490.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6034710>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_bff6c8a8bd9709aa00805918dc8fe906.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_bff6c8a8bd9709aa00805918dc8fe906.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603aa10>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_014d8093f1f8eda6ff7b8a30e6368780.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_014d8093f1f8eda6ff7b8a30e6368780.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_b0abb0a005244ca7095ba339f0efce5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_280c1942790eca79887759b23939bf61.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_ccab924cfee4850526f74d4fc9641f31.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d775f750>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_b0abb0a005244ca7095ba339f0efce5a.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_b0abb0a005244ca7095ba339f0efce5a.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc91bbd0>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_280c1942790eca79887759b23939bf61.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_280c1942790eca79887759b23939bf61.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60b8bd0>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fb6%252F75b65ec242c8b7a40abf0e7367f98f6e%252Fpa%252FWY41439_ccab924cfee4850526f74d4fc9641f31.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_ccab924cfee4850526f74d4fc9641f31.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53
2026-03-30 12:21:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 267d9a4a-2005-5b22-abb0-f7ce5795eb53, skipping ID generation
2026-03-30 12:21:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53 with scrape type 1
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 267d9a4a-2005-5b22-abb0-f7ce5795eb53 sending to next pipeline
2026-03-30 12:21:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 267d9a4a-2005-5b22-abb0-f7ce5795eb53, identifier: WY41439
2026-03-30 12:21:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 267d9a4a-2005-5b22-abb0-f7ce5795eb53 with identifier: WY41439
2026-03-30 12:21:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 267d9a4a-2005-5b22-abb0-f7ce5795eb53 with identifier: WY41439
2026-03-30 12:21:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 267d9a4a-2005-5b22-abb0-f7ce5795eb53 with identifier: WY41439 to the API
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_ccab924cfee4850526f74d4fc9641f31.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:27:28Z',
 'fuel_type': 'electro',
 'id': '267d9a4a-2005-5b22-abb0-f7ce5795eb53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY41439',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 103778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_ccab924cfee4850526f74d4fc9641f31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_280c1942790eca79887759b23939bf61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_b0abb0a005244ca7095ba339f0efce5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_014d8093f1f8eda6ff7b8a30e6368780.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_bff6c8a8bd9709aa00805918dc8fe906.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_267d9a4a-2005-5b22-abb0-f7ce5795eb53/267d9a4a-2005-5b22-abb0-f7ce5795eb53_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/b6/75b65ec242c8b7a40abf0e7367f98f6e/pa/WY41439_c6279e580852621aa5bc0370ed843490.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa electric drive 100 kW First Edition',
 'transmission': 'automatic',
 'trim': 'First Edition',
 'year': 2020}
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY41439%27 HTTP/1.1" 200 None
2026-03-30 12:21:14 [auto1.nl] INFO: Saving data for WY41439: {'created_time': 1774873274.280191, 'last_price_update_time': 1774873274.2802, 'auction_closing_time': 1774970848.0}
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY41439') HTTP/1.1" 204 0
2026-03-30 12:21:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.821(s), this was the 1st time calling it.
2026-03-30 12:21:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.958868695187112 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_89f2f0a7b298eb7c8d14714e1fa852bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_5e6ec19bbe832717b5e13a5c3880048c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60ba490>
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_89f2f0a7b298eb7c8d14714e1fa852bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_89f2f0a7b298eb7c8d14714e1fa852bc.jpg saved to cache
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbeb110>
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_5e6ec19bbe832717b5e13a5c3880048c.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_5e6ec19bbe832717b5e13a5c3880048c.jpg saved to cache
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_d803d8eac0e509285ffa0c88f459f575.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_ede4d8915636d896b040b63269dd5fd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6078510>
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_d803d8eac0e509285ffa0c88f459f575.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_d803d8eac0e509285ffa0c88f459f575.jpg saved to cache
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69fbf50>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_ede4d8915636d896b040b63269dd5fd0.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_ede4d8915636d896b040b63269dd5fd0.jpg saved to cache
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_b6ae9bb3084105c454106a5a0c91bfe1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_73286643dd22ef4278b2ddd6bb949c7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a86990>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_b6ae9bb3084105c454106a5a0c91bfe1.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_b6ae9bb3084105c454106a5a0c91bfe1.jpg saved to cache
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6078250>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_73286643dd22ef4278b2ddd6bb949c7e.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_73286643dd22ef4278b2ddd6bb949c7e.jpg saved to cache
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_0ffeec71ee504fde37a966cc8903b7e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_95e9341b2cc2cc560cbbfc257400d1bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a87250>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_0ffeec71ee504fde37a966cc8903b7e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_0ffeec71ee504fde37a966cc8903b7e8.jpg saved to cache
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.830(s), this was the 2nd time calling it.
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.816318756868624 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.739(s), this was the 2nd time calling it.
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.097227461530052 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603a6d0>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd8%252Fa9d824a6285f1598136e1ab2afc74bed%252Fpa%252FHH64260_95e9341b2cc2cc560cbbfc257400d1bb.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_95e9341b2cc2cc560cbbfc257400d1bb.jpg saved to cache
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba
2026-03-30 12:21:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba, skipping ID generation
2026-03-30 12:21:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba with scrape type 1
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba sending to next pipeline
2026-03-30 12:21:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba, identifier: HH64260
2026-03-30 12:21:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba with identifier: HH64260
2026-03-30 12:21:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba with identifier: HH64260
2026-03-30 12:21:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba with identifier: HH64260 to the API
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_95e9341b2cc2cc560cbbfc257400d1bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:34:15Z',
 'fuel_type': 'petrol',
 'id': '4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GKF85F',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH64260',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 148586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_95e9341b2cc2cc560cbbfc257400d1bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2725899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_0ffeec71ee504fde37a966cc8903b7e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_73286643dd22ef4278b2ddd6bb949c7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413038,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_b6ae9bb3084105c454106a5a0c91bfe1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2336329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_ede4d8915636d896b040b63269dd5fd0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2352906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_d803d8eac0e509285ffa0c88f459f575.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408919,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_5e6ec19bbe832717b5e13a5c3880048c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2366610,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_89f2f0a7b298eb7c8d14714e1fa852bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2948526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_c85b5d03575dffc871fab3a2459b0ea6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba/4fe6cc35-26e8-5e96-a4cb-a4b08f8491ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2284891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d8/a9d824a6285f1598136e1ab2afc74bed/pa/HH64260_3b7508bf450f776de7cafe569d6de811.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH64260%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.nl] INFO: Saving data for HH64260: {'created_time': 1774873276.553354, 'last_price_update_time': 1774873276.553364, 'auction_closing_time': 1774971255.0}
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH64260') HTTP/1.1" 204 0
2026-03-30 12:21:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:21:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:21:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN65044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG31477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS88690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.706(s), this was the 1st time calling it.
2026-03-30 12:21:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.505719832169959 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:22:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:22:07 [scrapy.extensions.logstats] INFO: Crawled 70 pages (at 5 pages/min), scraped 38 items (at 2 items/min)
2026-03-30 12:22:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX45692/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL79212> (referer: https://www.auto1.com/v1/car-details-view/LL79212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3244441e-fbbc-5c89-af1e-6907bc9179ef with identifier: LL79212
2026-03-30 12:22:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3244441e-fbbc-5c89-af1e-6907bc9179ef with scrape type 1
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_ae09e055681d33856054e73eed819977.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_ae09e055681d33856054e73eed819977.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_f6af14616af6506d6c08c4405d6d5125.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f6af14616af6506d6c08c4405d6d5125.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_8a563acf967e5b83e150da42ef26d3d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_8a563acf967e5b83e150da42ef26d3d5.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_08ef658df71943039ee5b1ecda9bde04.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_08ef658df71943039ee5b1ecda9bde04.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_f29b0026278affff2aacaa9945d40387.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f29b0026278affff2aacaa9945d40387.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_7914e8c9fad572b4c2128d7013809fc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_7914e8c9fad572b4c2128d7013809fc4.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_0b616fdf55d1f70f749a5ae4f1b08675.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_0b616fdf55d1f70f749a5ae4f1b08675.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_d519fe394d2cde35dc77029f3c140ddf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_d519fe394d2cde35dc77029f3c140ddf.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_fc56c23c83007cfa1c5c4aa905900134.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_fc56c23c83007cfa1c5c4aa905900134.jpg not downloaded yet
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_997c30dfd2a72faccbc809aa176cfa99.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_997c30dfd2a72faccbc809aa176cfa99.jpg not downloaded yet
2026-03-30 12:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_ae09e055681d33856054e73eed819977.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d600c950>
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_ae09e055681d33856054e73eed819977.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_ae09e055681d33856054e73eed819977.jpg saved to cache
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f6af14616af6506d6c08c4405d6d5125.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_997c30dfd2a72faccbc809aa176cfa99.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603a4d0>
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_f6af14616af6506d6c08c4405d6d5125.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f6af14616af6506d6c08c4405d6d5125.jpg saved to cache
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6056cd0>
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_997c30dfd2a72faccbc809aa176cfa99.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_997c30dfd2a72faccbc809aa176cfa99.jpg saved to cache
2026-03-30 12:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_fc56c23c83007cfa1c5c4aa905900134.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_d519fe394d2cde35dc77029f3c140ddf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d691c910>
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_fc56c23c83007cfa1c5c4aa905900134.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_fc56c23c83007cfa1c5c4aa905900134.jpg saved to cache
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_0b616fdf55d1f70f749a5ae4f1b08675.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d693df10>
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_d519fe394d2cde35dc77029f3c140ddf.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_d519fe394d2cde35dc77029f3c140ddf.jpg saved to cache
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_7914e8c9fad572b4c2128d7013809fc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d600dc10>
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_0b616fdf55d1f70f749a5ae4f1b08675.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_0b616fdf55d1f70f749a5ae4f1b08675.jpg saved to cache
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60521d0>
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_7914e8c9fad572b4c2128d7013809fc4.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_7914e8c9fad572b4c2128d7013809fc4.jpg saved to cache
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_08ef658df71943039ee5b1ecda9bde04.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f29b0026278affff2aacaa9945d40387.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d600f350>
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_08ef658df71943039ee5b1ecda9bde04.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_08ef658df71943039ee5b1ecda9bde04.jpg saved to cache
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ad1250>
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_f29b0026278affff2aacaa9945d40387.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f29b0026278affff2aacaa9945d40387.jpg saved to cache
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_8a563acf967e5b83e150da42ef26d3d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60de450>
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Ff9%252Ff1f96e60c9ce8bca69f30fd384231c68%252Fpa%252FLL79212_8a563acf967e5b83e150da42ef26d3d5.jpg') HTTP/1.1" 204 0
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_8a563acf967e5b83e150da42ef26d3d5.jpg saved to cache
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3244441e-fbbc-5c89-af1e-6907bc9179ef
2026-03-30 12:22:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3244441e-fbbc-5c89-af1e-6907bc9179ef, skipping ID generation
2026-03-30 12:22:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3244441e-fbbc-5c89-af1e-6907bc9179ef with scrape type 1
2026-03-30 12:22:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3244441e-fbbc-5c89-af1e-6907bc9179ef sending to next pipeline
2026-03-30 12:22:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3244441e-fbbc-5c89-af1e-6907bc9179ef, identifier: LL79212
2026-03-30 12:22:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3244441e-fbbc-5c89-af1e-6907bc9179ef with identifier: LL79212
2026-03-30 12:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3244441e-fbbc-5c89-af1e-6907bc9179ef with identifier: LL79212
2026-03-30 12:22:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3244441e-fbbc-5c89-af1e-6907bc9179ef with identifier: LL79212 to the API
2026-03-30 12:22:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_8a563acf967e5b83e150da42ef26d3d5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:01:08Z',
 'fuel_type': 'petrol',
 'id': '3244441e-fbbc-5c89-af1e-6907bc9179ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '29-XR-KH',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL79212',
 'listing': 'auction',
 'location': 'NL, Doetinchem',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 161264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_ae09e055681d33856054e73eed819977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f6af14616af6506d6c08c4405d6d5125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_8a563acf967e5b83e150da42ef26d3d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_08ef658df71943039ee5b1ecda9bde04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_f29b0026278affff2aacaa9945d40387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_7914e8c9fad572b4c2128d7013809fc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_0b616fdf55d1f70f749a5ae4f1b08675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_d519fe394d2cde35dc77029f3c140ddf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_fc56c23c83007cfa1c5c4aa905900134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3244441e-fbbc-5c89-af1e-6907bc9179ef/3244441e-fbbc-5c89-af1e-6907bc9179ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/f9/f1f96e60c9ce8bca69f30fd384231c68/pa/LL79212_997c30dfd2a72faccbc809aa176cfa99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.6 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2007}
2026-03-30 12:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL79212%27 HTTP/1.1" 200 None
2026-03-30 12:22:14 [auto1.nl] INFO: Saving data for LL79212: {'created_time': 1774873334.230789, 'last_price_update_time': 1774873334.230803, 'auction_closing_time': 1774969268.0}
2026-03-30 12:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LL79212') HTTP/1.1" 204 0
2026-03-30 12:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW70134> (referer: https://www.auto1.com/v1/car-details-view/HW70134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3bddc40-2904-53fd-a898-c6e85adf0306 with identifier: HW70134
2026-03-30 12:22:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3bddc40-2904-53fd-a898-c6e85adf0306 with scrape type 1
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3bddc40-2904-53fd-a898-c6e85adf0306
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_2f8025ee889fe4b349a5814dada8ee69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_2f8025ee889fe4b349a5814dada8ee69.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_dc418745942a3133ef8facb435190b0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_dc418745942a3133ef8facb435190b0b.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_ca9cf559b08c0232586cc89f76252c44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_ca9cf559b08c0232586cc89f76252c44.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_6eda4bccd15c784096bcab82a8afacf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_6eda4bccd15c784096bcab82a8afacf1.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_0b72cfda91a927b93001815ebb0b7cc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_0b72cfda91a927b93001815ebb0b7cc0.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_c6d088bf3260dea7b8059c0580334664.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_c6d088bf3260dea7b8059c0580334664.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_88a62e3c94dfedc10f92eb28c7d44319.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_88a62e3c94dfedc10f92eb28c7d44319.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_281e3e0de86c305b627896c9cc24484c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_281e3e0de86c305b627896c9cc24484c.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_437164685f713a9b12d1da49e36afe7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_437164685f713a9b12d1da49e36afe7d.jpg already downloaded
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F6e%252F396ef8b7bd39e69befab55a8725c78a3%252Fpa%252FHW70134_b1db05d2eeeed7e9b6001f3e50e9a238.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_b1db05d2eeeed7e9b6001f3e50e9a238.jpg already downloaded
2026-03-30 12:22:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c3bddc40-2904-53fd-a898-c6e85adf0306, identifier: HW70134
2026-03-30 12:22:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c3bddc40-2904-53fd-a898-c6e85adf0306 with identifier: HW70134
2026-03-30 12:22:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c3bddc40-2904-53fd-a898-c6e85adf0306 with identifier: HW70134
2026-03-30 12:22:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c3bddc40-2904-53fd-a898-c6e85adf0306 with identifier: HW70134 to the API
2026-03-30 12:22:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW70134>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:56:19Z',
 'fuel_type': 'hybrid',
 'id': 'c3bddc40-2904-53fd-a898-c6e85adf0306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KS030B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW70134',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'BMW',
 'model': '3er',
 'odometer': 171609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_2f8025ee889fe4b349a5814dada8ee69.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_dc418745942a3133ef8facb435190b0b.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_ca9cf559b08c0232586cc89f76252c44.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_6eda4bccd15c784096bcab82a8afacf1.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_0b72cfda91a927b93001815ebb0b7cc0.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_c6d088bf3260dea7b8059c0580334664.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_88a62e3c94dfedc10f92eb28c7d44319.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_281e3e0de86c305b627896c9cc24484c.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_437164685f713a9b12d1da49e36afe7d.jpg',
                'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_b1db05d2eeeed7e9b6001f3e50e9a238.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2689775,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_2f8025ee889fe4b349a5814dada8ee69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2892571,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_dc418745942a3133ef8facb435190b0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787410,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_ca9cf559b08c0232586cc89f76252c44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2994160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_6eda4bccd15c784096bcab82a8afacf1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_0b72cfda91a927b93001815ebb0b7cc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_c6d088bf3260dea7b8059c0580334664.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2509628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_88a62e3c94dfedc10f92eb28c7d44319.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_281e3e0de86c305b627896c9cc24484c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2681187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_437164685f713a9b12d1da49e36afe7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3bddc40-2904-53fd-a898-c6e85adf0306/c3bddc40-2904-53fd-a898-c6e85adf0306_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/6e/396ef8b7bd39e69befab55a8725c78a3/pa/HW70134_b1db05d2eeeed7e9b6001f3e50e9a238.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 12:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW70134%27 HTTP/1.1" 200 None
2026-03-30 12:22:17 [auto1.nl] INFO: Saving data for HW70134: {'created_time': 1774873337.207102, 'last_price_update_time': 1774873337.207116, 'auction_closing_time': 1774972579.0}
2026-03-30 12:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW70134') HTTP/1.1" 204 0
2026-03-30 12:22:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.724(s), this was the 1st time calling it.
2026-03-30 12:22:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.488763084769017 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:22:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ24490> (referer: https://www.auto1.com/v1/car-details-view/RZ24490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ae942a3-7de0-55d8-8073-57b1e9af8337 with identifier: RZ24490
2026-03-30 12:22:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae942a3-7de0-55d8-8073-57b1e9af8337 with scrape type 1
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ae942a3-7de0-55d8-8073-57b1e9af8337
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_920226beb2fd5f69a9dccb4ce7752272.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_920226beb2fd5f69a9dccb4ce7752272.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_e6491ca44a5fbf3900458d956c8b22dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_e6491ca44a5fbf3900458d956c8b22dd.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_652d58697a634e0227fff30b1a3a395d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_652d58697a634e0227fff30b1a3a395d.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_b6719dced875adb186331b5ef709a075.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_b6719dced875adb186331b5ef709a075.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_f7530d80b07599dd8c3c38205dec985e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_f7530d80b07599dd8c3c38205dec985e.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_b98892ea17721192757682ef728e8380.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_b98892ea17721192757682ef728e8380.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_1ca94788562da02aacfbb43d2a3f89f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_1ca94788562da02aacfbb43d2a3f89f6.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_82a3196672c5fbbcab6ca145ebca70e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_82a3196672c5fbbcab6ca145ebca70e6.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_3f4cd217bb6bfe2a8acb5fd235db01ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_3f4cd217bb6bfe2a8acb5fd235db01ae.jpg already downloaded
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F75%252Fb875ce6f6db64e7798c71d7fe011f2c0%252Fpa%252FRZ24490_c532704013e87b16ba5cc5e96d9a6c3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_c532704013e87b16ba5cc5e96d9a6c3a.jpg already downloaded
2026-03-30 12:22:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ae942a3-7de0-55d8-8073-57b1e9af8337, identifier: RZ24490
2026-03-30 12:22:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ae942a3-7de0-55d8-8073-57b1e9af8337 with identifier: RZ24490
2026-03-30 12:22:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ae942a3-7de0-55d8-8073-57b1e9af8337 with identifier: RZ24490
2026-03-30 12:22:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ae942a3-7de0-55d8-8073-57b1e9af8337 with identifier: RZ24490 to the API
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RZ24490>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:31:28Z',
 'fuel_type': 'petrol',
 'id': '9ae942a3-7de0-55d8-8073-57b1e9af8337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '1XBX73',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ24490',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 216578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_920226beb2fd5f69a9dccb4ce7752272.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_e6491ca44a5fbf3900458d956c8b22dd.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_652d58697a634e0227fff30b1a3a395d.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_b6719dced875adb186331b5ef709a075.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_f7530d80b07599dd8c3c38205dec985e.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_b98892ea17721192757682ef728e8380.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_1ca94788562da02aacfbb43d2a3f89f6.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_82a3196672c5fbbcab6ca145ebca70e6.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_3f4cd217bb6bfe2a8acb5fd235db01ae.jpg',
                'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_c532704013e87b16ba5cc5e96d9a6c3a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799428,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_920226beb2fd5f69a9dccb4ce7752272.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_e6491ca44a5fbf3900458d956c8b22dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_652d58697a634e0227fff30b1a3a395d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674818,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_b6719dced875adb186331b5ef709a075.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2698738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_f7530d80b07599dd8c3c38205dec985e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2665289,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_b98892ea17721192757682ef728e8380.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_1ca94788562da02aacfbb43d2a3f89f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_82a3196672c5fbbcab6ca145ebca70e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_3f4cd217bb6bfe2a8acb5fd235db01ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ae942a3-7de0-55d8-8073-57b1e9af8337/9ae942a3-7de0-55d8-8073-57b1e9af8337_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3049390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/75/b875ce6f6db64e7798c71d7fe011f2c0/pa/RZ24490_c532704013e87b16ba5cc5e96d9a6c3a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RZ24490%27 HTTP/1.1" 200 None
2026-03-30 12:22:58 [auto1.nl] INFO: Saving data for RZ24490: {'created_time': 1774873378.74857, 'last_price_update_time': 1774873378.748582, 'auction_closing_time': 1774971088.0}
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RZ24490') HTTP/1.1" 204 0
2026-03-30 12:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT64280> (referer: https://www.auto1.com/v1/car-details-view/HT64280/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36824284-b4b5-5d4a-8a4c-f9ef9389513e with identifier: HT64280
2026-03-30 12:23:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e with scrape type 1
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_aa1688f30fbd754bcc7f892edf9664c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aa1688f30fbd754bcc7f892edf9664c9.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_fde4f4b8729870cf7a19578b1d27265f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_fde4f4b8729870cf7a19578b1d27265f.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_71ef540d4235601c2284f022cffcf609.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_71ef540d4235601c2284f022cffcf609.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_3da6c3e76207713903983c06800f9b9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_3da6c3e76207713903983c06800f9b9e.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_0bfee0a78bef0934924962a07116a59f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_0bfee0a78bef0934924962a07116a59f.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_aab8028b514e172de479f215231b9e13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aab8028b514e172de479f215231b9e13.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_dcd534396c713d4d73ab01018604ce82.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_dcd534396c713d4d73ab01018604ce82.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_d4160879ad8281f19fbe4b9342929222.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_d4160879ad8281f19fbe4b9342929222.jpg not downloaded yet
2026-03-30 12:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aa1688f30fbd754bcc7f892edf9664c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_43d696744de5764e8a1919ad2e17bbec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_43d696744de5764e8a1919ad2e17bbec.jpg not downloaded yet
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_198a1a3eebd478e3a553933afd9d084b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_198a1a3eebd478e3a553933afd9d084b.jpg not downloaded yet
2026-03-30 12:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a86250>
2026-03-30 12:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_aa1688f30fbd754bcc7f892edf9664c9.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aa1688f30fbd754bcc7f892edf9664c9.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_71ef540d4235601c2284f022cffcf609.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_fde4f4b8729870cf7a19578b1d27265f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_0bfee0a78bef0934924962a07116a59f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_198a1a3eebd478e3a553933afd9d084b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aab8028b514e172de479f215231b9e13.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_dcd534396c713d4d73ab01018604ce82.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbf0a90>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_71ef540d4235601c2284f022cffcf609.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_71ef540d4235601c2284f022cffcf609.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_d4160879ad8281f19fbe4b9342929222.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6034bd0>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_fde4f4b8729870cf7a19578b1d27265f.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_fde4f4b8729870cf7a19578b1d27265f.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d696ac90>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_0bfee0a78bef0934924962a07116a59f.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_0bfee0a78bef0934924962a07116a59f.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6094350>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_198a1a3eebd478e3a553933afd9d084b.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_198a1a3eebd478e3a553933afd9d084b.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_3da6c3e76207713903983c06800f9b9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_43d696744de5764e8a1919ad2e17bbec.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d602c4d0>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_aab8028b514e172de479f215231b9e13.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aab8028b514e172de479f215231b9e13.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d696b990>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_dcd534396c713d4d73ab01018604ce82.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_dcd534396c713d4d73ab01018604ce82.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6037050>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_d4160879ad8281f19fbe4b9342929222.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_d4160879ad8281f19fbe4b9342929222.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d691c810>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_3da6c3e76207713903983c06800f9b9e.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_3da6c3e76207713903983c06800f9b9e.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aca610>
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb8%252F18b88fc046d3139bca073141c2bff09e%252Fpa%252FHT64280_43d696744de5764e8a1919ad2e17bbec.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_43d696744de5764e8a1919ad2e17bbec.jpg saved to cache
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e
2026-03-30 12:23:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36824284-b4b5-5d4a-8a4c-f9ef9389513e, skipping ID generation
2026-03-30 12:23:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e with scrape type 1
2026-03-30 12:23:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36824284-b4b5-5d4a-8a4c-f9ef9389513e sending to next pipeline
2026-03-30 12:23:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36824284-b4b5-5d4a-8a4c-f9ef9389513e, identifier: HT64280
2026-03-30 12:23:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36824284-b4b5-5d4a-8a4c-f9ef9389513e with identifier: HT64280
2026-03-30 12:23:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36824284-b4b5-5d4a-8a4c-f9ef9389513e with identifier: HT64280
2026-03-30 12:23:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36824284-b4b5-5d4a-8a4c-f9ef9389513e with identifier: HT64280 to the API
2026-03-30 12:23:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_43d696744de5764e8a1919ad2e17bbec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:22:53Z',
 'fuel_type': 'petrol',
 'id': '36824284-b4b5-5d4a-8a4c-f9ef9389513e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT64280',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 112663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aa1688f30fbd754bcc7f892edf9664c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_fde4f4b8729870cf7a19578b1d27265f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_71ef540d4235601c2284f022cffcf609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_3da6c3e76207713903983c06800f9b9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_0bfee0a78bef0934924962a07116a59f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_aab8028b514e172de479f215231b9e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_dcd534396c713d4d73ab01018604ce82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_d4160879ad8281f19fbe4b9342929222.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_43d696744de5764e8a1919ad2e17bbec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36824284-b4b5-5d4a-8a4c-f9ef9389513e/36824284-b4b5-5d4a-8a4c-f9ef9389513e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b8/18b88fc046d3139bca073141c2bff09e/pa/HT64280_198a1a3eebd478e3a553933afd9d084b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT64280%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [auto1.nl] INFO: Saving data for HT64280: {'created_time': 1774873384.166592, 'last_price_update_time': 1774873384.166612, 'auction_closing_time': 1774970573.0}
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT64280') HTTP/1.1" 204 0
2026-03-30 12:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN65044> (referer: https://www.auto1.com/v1/car-details-view/UN65044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e9359fe-64e8-571f-828a-4403fd48d905 with identifier: UN65044
2026-03-30 12:23:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e9359fe-64e8-571f-828a-4403fd48d905 with scrape type 1
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e9359fe-64e8-571f-828a-4403fd48d905
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_f0a262d1cb397309fa4aaffcf09443c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_f0a262d1cb397309fa4aaffcf09443c3.jpg already downloaded
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_0c165e79d2c26391e5d652f218b3de50.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_0c165e79d2c26391e5d652f218b3de50.jpg already downloaded
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_48b6f59f7c117646af3980f6cf9778c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_48b6f59f7c117646af3980f6cf9778c0.jpg already downloaded
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_04e6805bd880214c07fbb1168eb7485e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_04e6805bd880214c07fbb1168eb7485e.jpg already downloaded
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_abe339cd23d2a1ee3dc324d6e771b695.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_abe339cd23d2a1ee3dc324d6e771b695.jpg already downloaded
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_5cac55aa335b7167f1cae98457472e7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_5cac55aa335b7167f1cae98457472e7a.jpg already downloaded
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_a063d4518539f8a2d1f1fe1b00ab81d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_a063d4518539f8a2d1f1fe1b00ab81d2.jpg already downloaded
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_5bb780b1bba13435e7b3b3a05760cf6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_5bb780b1bba13435e7b3b3a05760cf6e.jpg already downloaded
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_abf3631ebbff7426c75393199167693a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_abf3631ebbff7426c75393199167693a.jpg already downloaded
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F4b%252F894bb8e38d473742b2cbfc3dbf2924b6%252Fpa%252FUN65044_43909741b3a0d2ccf6e6f1bbf88f498b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_43909741b3a0d2ccf6e6f1bbf88f498b.jpg already downloaded
2026-03-30 12:23:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e9359fe-64e8-571f-828a-4403fd48d905, identifier: UN65044
2026-03-30 12:23:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e9359fe-64e8-571f-828a-4403fd48d905 with identifier: UN65044
2026-03-30 12:23:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e9359fe-64e8-571f-828a-4403fd48d905 with identifier: UN65044
2026-03-30 12:23:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e9359fe-64e8-571f-828a-4403fd48d905 with identifier: UN65044 to the API
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UN65044>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:26:13Z',
 'fuel_type': 'petrol',
 'id': '7e9359fe-64e8-571f-828a-4403fd48d905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GP552T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN65044',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 119783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_f0a262d1cb397309fa4aaffcf09443c3.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_0c165e79d2c26391e5d652f218b3de50.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_48b6f59f7c117646af3980f6cf9778c0.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_04e6805bd880214c07fbb1168eb7485e.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_abe339cd23d2a1ee3dc324d6e771b695.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_5cac55aa335b7167f1cae98457472e7a.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_a063d4518539f8a2d1f1fe1b00ab81d2.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_5bb780b1bba13435e7b3b3a05760cf6e.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_abf3631ebbff7426c75393199167693a.jpg',
                'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_43909741b3a0d2ccf6e6f1bbf88f498b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_f0a262d1cb397309fa4aaffcf09443c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_0c165e79d2c26391e5d652f218b3de50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_48b6f59f7c117646af3980f6cf9778c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_04e6805bd880214c07fbb1168eb7485e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_abe339cd23d2a1ee3dc324d6e771b695.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_5cac55aa335b7167f1cae98457472e7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_a063d4518539f8a2d1f1fe1b00ab81d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_5bb780b1bba13435e7b3b3a05760cf6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_abf3631ebbff7426c75393199167693a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9359fe-64e8-571f-828a-4403fd48d905/7e9359fe-64e8-571f-828a-4403fd48d905_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/4b/894bb8e38d473742b2cbfc3dbf2924b6/pa/UN65044_43909741b3a0d2ccf6e6f1bbf88f498b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2013}
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UN65044%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [auto1.nl] INFO: Saving data for UN65044: {'created_time': 1774873387.498826, 'last_price_update_time': 1774873387.498837, 'auction_closing_time': 1774970773.0}
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UN65044') HTTP/1.1" 204 0
2026-03-30 12:23:07 [scrapy.extensions.logstats] INFO: Crawled 76 pages (at 6 pages/min), scraped 43 items (at 5 items/min)
2026-03-30 12:23:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:23:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.566(s), this was the 1st time calling it.
2026-03-30 12:23:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.967294712363154 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.651(s), this was the 1st time calling it.
2026-03-30 12:23:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.832311105080927 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG31477> (referer: https://www.auto1.com/v1/car-details-view/GG31477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b1e4ba-481d-5ac3-af57-c3cae13b3051 with identifier: GG31477
2026-03-30 12:23:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b1e4ba-481d-5ac3-af57-c3cae13b3051 with scrape type 1
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3b1e4ba-481d-5ac3-af57-c3cae13b3051
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_fda450c1323994e316b00ceb870c6005.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_fda450c1323994e316b00ceb870c6005.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_e9c2fecfdb780c34b1a38289e90dda9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_e9c2fecfdb780c34b1a38289e90dda9f.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_6307893503efdf19c125754b966b42a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_6307893503efdf19c125754b966b42a6.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_850e8678da24a30cf58598bca7c7996a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_850e8678da24a30cf58598bca7c7996a.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_fde62262ffa1d5c05bac986d8864d8c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_fde62262ffa1d5c05bac986d8864d8c1.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_244bf54fe900f45c5539a608b46e99db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_244bf54fe900f45c5539a608b46e99db.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_b91a61144d8b25e2100a11fe917e0a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_b91a61144d8b25e2100a11fe917e0a63.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_4b17ad6a9400adff5f45bd2989e9e310.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_4b17ad6a9400adff5f45bd2989e9e310.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_37baef8d97a95a8f582fab21af75b149.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_37baef8d97a95a8f582fab21af75b149.jpg already downloaded
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F49%252F4d490e8805465c469345e44e1b1f7101%252Fpa%252FGG31477_25f8566d3b0b19b44a747ce002d8990f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_25f8566d3b0b19b44a747ce002d8990f.jpg already downloaded
2026-03-30 12:23:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b3b1e4ba-481d-5ac3-af57-c3cae13b3051, identifier: GG31477
2026-03-30 12:23:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b3b1e4ba-481d-5ac3-af57-c3cae13b3051 with identifier: GG31477
2026-03-30 12:23:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b3b1e4ba-481d-5ac3-af57-c3cae13b3051 with identifier: GG31477
2026-03-30 12:23:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b3b1e4ba-481d-5ac3-af57-c3cae13b3051 with identifier: GG31477 to the API
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GG31477>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 410,
 'expiration_date': '2026-03-31T15:42:12Z',
 'fuel_type': 'petrol',
 'id': 'b3b1e4ba-481d-5ac3-af57-c3cae13b3051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K747TJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG31477',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Maserati',
 'model': 'Ghibli',
 'odometer': 133156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_fda450c1323994e316b00ceb870c6005.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_e9c2fecfdb780c34b1a38289e90dda9f.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_6307893503efdf19c125754b966b42a6.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_850e8678da24a30cf58598bca7c7996a.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_fde62262ffa1d5c05bac986d8864d8c1.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_244bf54fe900f45c5539a608b46e99db.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_b91a61144d8b25e2100a11fe917e0a63.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_4b17ad6a9400adff5f45bd2989e9e310.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_37baef8d97a95a8f582fab21af75b149.jpg',
                'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_25f8566d3b0b19b44a747ce002d8990f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_fda450c1323994e316b00ceb870c6005.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670380,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_e9c2fecfdb780c34b1a38289e90dda9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_6307893503efdf19c125754b966b42a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803356,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_850e8678da24a30cf58598bca7c7996a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2898878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_fde62262ffa1d5c05bac986d8864d8c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2862252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_244bf54fe900f45c5539a608b46e99db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2918728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_b91a61144d8b25e2100a11fe917e0a63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_4b17ad6a9400adff5f45bd2989e9e310.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_37baef8d97a95a8f582fab21af75b149.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b1e4ba-481d-5ac3-af57-c3cae13b3051/b3b1e4ba-481d-5ac3-af57-c3cae13b3051_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/49/4d490e8805465c469345e44e1b1f7101/pa/GG31477_25f8566d3b0b19b44a747ce002d8990f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Ghibli 3.0 V6 TwinTurbo S Q4',
 'transmission': 'automatic',
 'trim': 'S Q4',
 'year': 2016}
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG31477%27 HTTP/1.1" 200 None
2026-03-30 12:23:20 [auto1.nl] INFO: Saving data for GG31477: {'created_time': 1774873400.198927, 'last_price_update_time': 1774873400.198966, 'auction_closing_time': 1774971732.0}
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG31477') HTTP/1.1" 204 0
2026-03-30 12:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS88690> (referer: https://www.auto1.com/v1/car-details-view/MS88690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b6f9bc-673a-536c-a1b3-c7af0b16ff73 with identifier: MS88690
2026-03-30 12:23:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b6f9bc-673a-536c-a1b3-c7af0b16ff73 with scrape type 1
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15b6f9bc-673a-536c-a1b3-c7af0b16ff73
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_82d9b3c30794de6ae7d91b35b250de8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_82d9b3c30794de6ae7d91b35b250de8b.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_fe7ab3fbeefec9b4ba78373ef7f4e86d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_fe7ab3fbeefec9b4ba78373ef7f4e86d.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_78409dce83e8a893da0b63021581b3f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_78409dce83e8a893da0b63021581b3f7.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_762aea92e8d79577bad3868ad1928f7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_762aea92e8d79577bad3868ad1928f7f.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_e611914690c55d693521a64119ab264e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_e611914690c55d693521a64119ab264e.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_83464eda78936a82998496f788c84344.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_83464eda78936a82998496f788c84344.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_c16d09f97f4af4883b452176b6077cbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_c16d09f97f4af4883b452176b6077cbe.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_b94ffc5d7eb3a37f7488a42b577630ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_b94ffc5d7eb3a37f7488a42b577630ee.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_a8d0731e276110ef149c844a3f13244b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_a8d0731e276110ef149c844a3f13244b.jpg already downloaded
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fe7%252Fe6e7a1a1488247978a69ce13aebee513%252Fpa%252FMS88690_16692543f01c1abbdba268189cfee46f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_16692543f01c1abbdba268189cfee46f.jpg already downloaded
2026-03-30 12:23:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 15b6f9bc-673a-536c-a1b3-c7af0b16ff73, identifier: MS88690
2026-03-30 12:23:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 15b6f9bc-673a-536c-a1b3-c7af0b16ff73 with identifier: MS88690
2026-03-30 12:23:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 15b6f9bc-673a-536c-a1b3-c7af0b16ff73 with identifier: MS88690
2026-03-30 12:23:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 15b6f9bc-673a-536c-a1b3-c7af0b16ff73 with identifier: MS88690 to the API
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MS88690>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:18:34Z',
 'fuel_type': 'petrol',
 'id': '15b6f9bc-673a-536c-a1b3-c7af0b16ff73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L689JX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS88690',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 129677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_82d9b3c30794de6ae7d91b35b250de8b.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_fe7ab3fbeefec9b4ba78373ef7f4e86d.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_78409dce83e8a893da0b63021581b3f7.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_762aea92e8d79577bad3868ad1928f7f.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_e611914690c55d693521a64119ab264e.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_83464eda78936a82998496f788c84344.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_c16d09f97f4af4883b452176b6077cbe.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_b94ffc5d7eb3a37f7488a42b577630ee.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_a8d0731e276110ef149c844a3f13244b.jpg',
                'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_16692543f01c1abbdba268189cfee46f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_82d9b3c30794de6ae7d91b35b250de8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_fe7ab3fbeefec9b4ba78373ef7f4e86d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_78409dce83e8a893da0b63021581b3f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_762aea92e8d79577bad3868ad1928f7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_e611914690c55d693521a64119ab264e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_83464eda78936a82998496f788c84344.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2875315,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_c16d09f97f4af4883b452176b6077cbe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3221167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_b94ffc5d7eb3a37f7488a42b577630ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3105857,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_a8d0731e276110ef149c844a3f13244b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b6f9bc-673a-536c-a1b3-c7af0b16ff73/15b6f9bc-673a-536c-a1b3-c7af0b16ff73_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3073637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/e7/e6e7a1a1488247978a69ce13aebee513/pa/MS88690_16692543f01c1abbdba268189cfee46f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MS88690%27 HTTP/1.1" 200 None
2026-03-30 12:23:22 [auto1.nl] INFO: Saving data for MS88690: {'created_time': 1774873402.00085, 'last_price_update_time': 1774873402.00086, 'auction_closing_time': 1774970314.0}
2026-03-30 12:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MS88690') HTTP/1.1" 204 0
2026-03-30 12:23:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ15227> (referer: https://www.auto1.com/v1/car-details-view/HZ15227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3304c39-9179-5716-9d8b-6e9254b4e379 with identifier: HZ15227
2026-03-30 12:23:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3304c39-9179-5716-9d8b-6e9254b4e379 with scrape type 1
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_5f1fa76a3a29c9c576ed1859d2c6e857.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_5f1fa76a3a29c9c576ed1859d2c6e857.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_88bb1be4b4c278f5f9a4eb4733eb3bae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_88bb1be4b4c278f5f9a4eb4733eb3bae.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_ebc565f4a46627e21be454236f6dcea2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_ebc565f4a46627e21be454236f6dcea2.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_a153277cd56499099e6385cd3d5391f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a153277cd56499099e6385cd3d5391f3.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_0b77b58dc6e56922870b0112bcc16e3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_0b77b58dc6e56922870b0112bcc16e3d.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_b912a56028b02e3027ba982705075851.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b912a56028b02e3027ba982705075851.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_56e1ac538f03da8ba5ce0c9e286a0159.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_56e1ac538f03da8ba5ce0c9e286a0159.jpg not downloaded yet
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_88bb1be4b4c278f5f9a4eb4733eb3bae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_b84796b5cd394d732f030f143f8ab6cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b84796b5cd394d732f030f143f8ab6cc.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_a707faed4a88d39e2c2730f4f54974e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a707faed4a88d39e2c2730f4f54974e2.jpg not downloaded yet
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_21dfe22669884924bc78f626d5ca5be5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_21dfe22669884924bc78f626d5ca5be5.jpg not downloaded yet
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ae3110>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_88bb1be4b4c278f5f9a4eb4733eb3bae.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_88bb1be4b4c278f5f9a4eb4733eb3bae.jpg saved to cache
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_5f1fa76a3a29c9c576ed1859d2c6e857.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a153277cd56499099e6385cd3d5391f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_56e1ac538f03da8ba5ce0c9e286a0159.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_ebc565f4a46627e21be454236f6dcea2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_0b77b58dc6e56922870b0112bcc16e3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:23:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:23:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:23:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:23:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d691e0d0>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_5f1fa76a3a29c9c576ed1859d2c6e857.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_5f1fa76a3a29c9c576ed1859d2c6e857.jpg saved to cache
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a707faed4a88d39e2c2730f4f54974e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_21dfe22669884924bc78f626d5ca5be5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6035750>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_a153277cd56499099e6385cd3d5391f3.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a153277cd56499099e6385cd3d5391f3.jpg saved to cache
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f633d0>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_56e1ac538f03da8ba5ce0c9e286a0159.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_56e1ac538f03da8ba5ce0c9e286a0159.jpg saved to cache
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6981810>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_ebc565f4a46627e21be454236f6dcea2.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_ebc565f4a46627e21be454236f6dcea2.jpg saved to cache
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f71890>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_0b77b58dc6e56922870b0112bcc16e3d.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_0b77b58dc6e56922870b0112bcc16e3d.jpg saved to cache
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b912a56028b02e3027ba982705075851.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b84796b5cd394d732f030f143f8ab6cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f769d0>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_a707faed4a88d39e2c2730f4f54974e2.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a707faed4a88d39e2c2730f4f54974e2.jpg saved to cache
2026-03-30 12:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69661d0>
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_21dfe22669884924bc78f626d5ca5be5.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_21dfe22669884924bc78f626d5ca5be5.jpg saved to cache
2026-03-30 12:23:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a60bd0>
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_b912a56028b02e3027ba982705075851.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b912a56028b02e3027ba982705075851.jpg saved to cache
2026-03-30 12:23:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f1dfd0>
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fef%252F01ef39fba06914e66aadbe184c4cc5d5%252Fpa%252FHZ15227_b84796b5cd394d732f030f143f8ab6cc.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b84796b5cd394d732f030f143f8ab6cc.jpg saved to cache
2026-03-30 12:23:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3304c39-9179-5716-9d8b-6e9254b4e379
2026-03-30 12:23:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3304c39-9179-5716-9d8b-6e9254b4e379, skipping ID generation
2026-03-30 12:23:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3304c39-9179-5716-9d8b-6e9254b4e379 with scrape type 1
2026-03-30 12:23:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3304c39-9179-5716-9d8b-6e9254b4e379 sending to next pipeline
2026-03-30 12:23:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f3304c39-9179-5716-9d8b-6e9254b4e379, identifier: HZ15227
2026-03-30 12:23:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f3304c39-9179-5716-9d8b-6e9254b4e379 with identifier: HZ15227
2026-03-30 12:23:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f3304c39-9179-5716-9d8b-6e9254b4e379 with identifier: HZ15227
2026-03-30 12:23:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f3304c39-9179-5716-9d8b-6e9254b4e379 with identifier: HZ15227 to the API
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b84796b5cd394d732f030f143f8ab6cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:08:42Z',
 'fuel_type': 'diesel',
 'id': 'f3304c39-9179-5716-9d8b-6e9254b4e379',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ15227',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 217551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3812932,
             'Height': 4284,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_5f1fa76a3a29c9c576ed1859d2c6e857.jpg',
             'Width': 5712},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_88bb1be4b4c278f5f9a4eb4733eb3bae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_ebc565f4a46627e21be454236f6dcea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a153277cd56499099e6385cd3d5391f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_0b77b58dc6e56922870b0112bcc16e3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b912a56028b02e3027ba982705075851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_56e1ac538f03da8ba5ce0c9e286a0159.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_b84796b5cd394d732f030f143f8ab6cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_a707faed4a88d39e2c2730f4f54974e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3304c39-9179-5716-9d8b-6e9254b4e379/f3304c39-9179-5716-9d8b-6e9254b4e379_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ef/01ef39fba06914e66aadbe184c4cc5d5/pa/HZ15227_21dfe22669884924bc78f626d5ca5be5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ15227%27 HTTP/1.1" 200 None
2026-03-30 12:23:24 [auto1.nl] INFO: Saving data for HZ15227: {'created_time': 1774873404.635643, 'last_price_update_time': 1774873404.635659, 'auction_closing_time': 1774969722.0}
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ15227') HTTP/1.1" 204 0
2026-03-30 12:23:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU60882> (referer: https://www.auto1.com/v1/car-details-view/BU60882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d287a4-1c72-5214-97fa-c7f55f3ad0c9 with identifier: BU60882
2026-03-30 12:23:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9 with scrape type 1
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_6057bf2debf4f4e60f3cf5da0645c3a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6057bf2debf4f4e60f3cf5da0645c3a9.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_8a6c9d5db461a7cf88dcce737e695f28.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_8a6c9d5db461a7cf88dcce737e695f28.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_5155baabc5f1ac2f8d3839256225fba2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_5155baabc5f1ac2f8d3839256225fba2.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_69738492ec0d9ea5df9b597e30989cd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_69738492ec0d9ea5df9b597e30989cd8.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_08fd97255e5dbc7db4ce8cb440c4e829.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_08fd97255e5dbc7db4ce8cb440c4e829.jpg not downloaded yet
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6057bf2debf4f4e60f3cf5da0645c3a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_faa8f126600b2e76b1478fa78a123109.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_faa8f126600b2e76b1478fa78a123109.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_bcb991cf58ac67481db90296b6252f35.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_bcb991cf58ac67481db90296b6252f35.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_6e6e60660a953d99d502129f6bad797b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6e6e60660a953d99d502129f6bad797b.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_cf95f6983364b5fc9d8064cd9bcdb92b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_cf95f6983364b5fc9d8064cd9bcdb92b.jpg not downloaded yet
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_ad2e4c7062b211e01b613476455d2c76.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_ad2e4c7062b211e01b613476455d2c76.jpg not downloaded yet
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a80950>
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_6057bf2debf4f4e60f3cf5da0645c3a9.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6057bf2debf4f4e60f3cf5da0645c3a9.jpg saved to cache
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_69738492ec0d9ea5df9b597e30989cd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_8a6c9d5db461a7cf88dcce737e695f28.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_5155baabc5f1ac2f8d3839256225fba2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_faa8f126600b2e76b1478fa78a123109.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_08fd97255e5dbc7db4ce8cb440c4e829.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6e6e60660a953d99d502129f6bad797b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d775ec10>
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_69738492ec0d9ea5df9b597e30989cd8.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_69738492ec0d9ea5df9b597e30989cd8.jpg saved to cache
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_bcb991cf58ac67481db90296b6252f35.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_cf95f6983364b5fc9d8064cd9bcdb92b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f04cd0>
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_8a6c9d5db461a7cf88dcce737e695f28.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_8a6c9d5db461a7cf88dcce737e695f28.jpg saved to cache
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6df10>
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_5155baabc5f1ac2f8d3839256225fba2.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_5155baabc5f1ac2f8d3839256225fba2.jpg saved to cache
2026-03-30 12:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f44150>
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_faa8f126600b2e76b1478fa78a123109.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_faa8f126600b2e76b1478fa78a123109.jpg saved to cache
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6f390>
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_08fd97255e5dbc7db4ce8cb440c4e829.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_08fd97255e5dbc7db4ce8cb440c4e829.jpg saved to cache
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f7d710>
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_6e6e60660a953d99d502129f6bad797b.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6e6e60660a953d99d502129f6bad797b.jpg saved to cache
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_ad2e4c7062b211e01b613476455d2c76.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6f850>
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_bcb991cf58ac67481db90296b6252f35.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_bcb991cf58ac67481db90296b6252f35.jpg saved to cache
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60dc490>
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_cf95f6983364b5fc9d8064cd9bcdb92b.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_cf95f6983364b5fc9d8064cd9bcdb92b.jpg saved to cache
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60cdc90>
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa7%252Fe9a70f22cb46207069c2cb4614927e14%252Fpa%252FBU60882_ad2e4c7062b211e01b613476455d2c76.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_ad2e4c7062b211e01b613476455d2c76.jpg saved to cache
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9
2026-03-30 12:23:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4d287a4-1c72-5214-97fa-c7f55f3ad0c9, skipping ID generation
2026-03-30 12:23:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9 with scrape type 1
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4d287a4-1c72-5214-97fa-c7f55f3ad0c9 sending to next pipeline
2026-03-30 12:23:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4d287a4-1c72-5214-97fa-c7f55f3ad0c9, identifier: BU60882
2026-03-30 12:23:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4d287a4-1c72-5214-97fa-c7f55f3ad0c9 with identifier: BU60882
2026-03-30 12:23:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4d287a4-1c72-5214-97fa-c7f55f3ad0c9 with identifier: BU60882
2026-03-30 12:23:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4d287a4-1c72-5214-97fa-c7f55f3ad0c9 with identifier: BU60882 to the API
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_ad2e4c7062b211e01b613476455d2c76.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:33:37Z',
 'fuel_type': 'petrol',
 'id': 'e4d287a4-1c72-5214-97fa-c7f55f3ad0c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ST854R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU60882',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'BMW',
 'model': '3er',
 'odometer': 207836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6057bf2debf4f4e60f3cf5da0645c3a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_8a6c9d5db461a7cf88dcce737e695f28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_5155baabc5f1ac2f8d3839256225fba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_69738492ec0d9ea5df9b597e30989cd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_08fd97255e5dbc7db4ce8cb440c4e829.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608192,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_faa8f126600b2e76b1478fa78a123109.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_bcb991cf58ac67481db90296b6252f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3005258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_6e6e60660a953d99d502129f6bad797b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_cf95f6983364b5fc9d8064cd9bcdb92b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d287a4-1c72-5214-97fa-c7f55f3ad0c9/e4d287a4-1c72-5214-97fa-c7f55f3ad0c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a7/e9a70f22cb46207069c2cb4614927e14/pa/BU60882_ad2e4c7062b211e01b613476455d2c76.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2018}
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU60882%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [auto1.nl] INFO: Saving data for BU60882: {'created_time': 1774873407.8672, 'last_price_update_time': 1774873407.867211, 'auction_closing_time': 1774971217.0}
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU60882') HTTP/1.1" 204 0
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.586(s), this was the 2nd time calling it.
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.996128732073372 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:31 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 1032 | hits on page: 40
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: BU60882
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU60882%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [auto1.nl] INFO: Scrape type for BU60882: 0
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: FZ71545
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: AJ76364
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: LY70010
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: SB41881
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB41881%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [auto1.nl] INFO: Scrape type for SB41881: 1
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: LC34578
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: GA01556
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA01556%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [auto1.nl] INFO: Scrape type for GA01556: 1
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:31 [auto1.nl] INFO: Found listing with ID: LU56377
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU56377%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [auto1.nl] INFO: Scrape type for LU56377: 2
2026-03-30 12:23:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7215689c-d6d0-510b-a07b-edbd5fce09ef with identifier: LU56377
2026-03-30 12:23:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7215689c-d6d0-510b-a07b-edbd5fce09ef with scrape type 2
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7215689c-d6d0-510b-a07b-edbd5fce09ef with scrape type 2
2026-03-30 12:23:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7215689c-d6d0-510b-a07b-edbd5fce09ef, identifier: LU56377
2026-03-30 12:23:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7215689c-d6d0-510b-a07b-edbd5fce09ef with identifier: LU56377
2026-03-30 12:23:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7215689c-d6d0-510b-a07b-edbd5fce09ef with identifier: LU56377
2026-03-30 12:23:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7215689c-d6d0-510b-a07b-edbd5fce09ef with identifier: LU56377 to the API
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:06:06Z',
 'fuel_type': 'petrol',
 'id': '7215689c-d6d0-510b-a07b-edbd5fce09ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU56377',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 69966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU56377%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Saving data for LU56377: {'auction_closing_time': 1774969566.0, 'created_time': 1774293099.191057, 'last_price_update_time': 1774873412.06039}
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LU56377') HTTP/1.1" 204 0
2026-03-30 12:23:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: AB98893
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB98893%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for AB98893: 1
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: JP46089
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: ZR70834
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: FF84926
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF84926%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for FF84926: 1
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: EH68093
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: EM83384
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: CS80457
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for WL71666: 2
2026-03-30 12:23:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666
2026-03-30 12:23:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a5d592-41f4-5848-9eca-8229df382afe with scrape type 2
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a5d592-41f4-5848-9eca-8229df382afe with scrape type 2
2026-03-30 12:23:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1a5d592-41f4-5848-9eca-8229df382afe, identifier: WL71666
2026-03-30 12:23:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666
2026-03-30 12:23:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666
2026-03-30 12:23:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666 to the API
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:56:03Z',
 'fuel_type': 'petrol',
 'id': 'f1a5d592-41f4-5848-9eca-8229df382afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL71666',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 219168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-19',
 'seller_name': None,
 'title': 'Volvo V70 2.0 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2008}
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Saving data for WL71666: {'auction_closing_time': 1774972563.0, 'created_time': 1774527052.49243, 'last_price_update_time': 1774873412.771356}
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WL71666') HTTP/1.1" 204 0
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: HK91106
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK91106%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for HK91106: 1
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: LW12392
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: SE40688
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE40688%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for SE40688: 1
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: EK69349
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK69349%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for EK69349: 1
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: RB40697
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: UT02482
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT02482%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for UT02482: 1
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: HD80531
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: CV57323
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: JZ86635
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: AP42926
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: MM80557
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: NE79175
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: YB99145
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB99145%27 HTTP/1.1" 200 None
2026-03-30 12:23:32 [auto1.nl] INFO: Scrape type for YB99145: 1
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: KZ62964
2026-03-30 12:23:32 [auto1.nl] INFO: Found listing with ID: GH07415
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH07415%27 HTTP/1.1" 200 None
2026-03-30 12:23:33 [auto1.nl] INFO: Scrape type for GH07415: 1
2026-03-30 12:23:33 [auto1.nl] INFO: Found listing with ID: US84379
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US84379%27 HTTP/1.1" 200 None
2026-03-30 12:23:33 [auto1.nl] INFO: Scrape type for US84379: 1
2026-03-30 12:23:33 [auto1.nl] INFO: Found listing with ID: PK33292
2026-03-30 12:23:33 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-30 12:23:33 [auto1.nl] INFO: Found listing with ID: CV55597
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV55597%27 HTTP/1.1" 200 None
2026-03-30 12:23:33 [auto1.nl] INFO: Scrape type for CV55597: 2
2026-03-30 12:23:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f037f3-1594-527e-a2cf-cde9d0cf0693 with identifier: CV55597
2026-03-30 12:23:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f037f3-1594-527e-a2cf-cde9d0cf0693 with scrape type 2
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8f037f3-1594-527e-a2cf-cde9d0cf0693 with scrape type 2
2026-03-30 12:23:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c8f037f3-1594-527e-a2cf-cde9d0cf0693, identifier: CV55597
2026-03-30 12:23:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c8f037f3-1594-527e-a2cf-cde9d0cf0693 with identifier: CV55597
2026-03-30 12:23:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c8f037f3-1594-527e-a2cf-cde9d0cf0693 with identifier: CV55597
2026-03-30 12:23:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c8f037f3-1594-527e-a2cf-cde9d0cf0693 with identifier: CV55597 to the API
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:06:38Z',
 'fuel_type': 'petrol',
 'id': 'c8f037f3-1594-527e-a2cf-cde9d0cf0693',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV55597',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 293945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-02',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV55597%27 HTTP/1.1" 200 None
2026-03-30 12:23:33 [auto1.nl] INFO: Saving data for CV55597: {'auction_closing_time': 1774969598.0, 'created_time': 1773132095.059911, 'last_price_update_time': 1774873413.523485}
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV55597') HTTP/1.1" 204 0
2026-03-30 12:23:33 [auto1.nl] INFO: Found listing with ID: ZK45819
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK45819%27 HTTP/1.1" 200 None
2026-03-30 12:23:33 [auto1.nl] INFO: Scrape type for ZK45819: 1
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.158(s), this was the 1st time calling it.
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.664915702468615 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.539(s), this was the 1st time calling it.
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.414577584380403 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.896(s), this was the 1st time calling it.
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.978752662263318 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:23:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY41956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:41 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 1032 | hits on page: 40
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: PT85838
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT85838%27 HTTP/1.1" 200 None
2026-03-30 12:23:41 [auto1.nl] INFO: Scrape type for PT85838: 1
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: ST56241
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: ZG81860
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: YC70915
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC70915%27 HTTP/1.1" 200 None
2026-03-30 12:23:41 [auto1.nl] INFO: Scrape type for YC70915: 1
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: SD51522
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD51522%27 HTTP/1.1" 200 None
2026-03-30 12:23:41 [auto1.nl] INFO: Scrape type for SD51522: 1
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: SB09763
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB09763%27 HTTP/1.1" 200 None
2026-03-30 12:23:41 [auto1.nl] INFO: Scrape type for SB09763: 2
2026-03-30 12:23:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4 with identifier: SB09763
2026-03-30 12:23:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4 with scrape type 2
2026-03-30 12:23:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4 with scrape type 2
2026-03-30 12:23:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4, identifier: SB09763
2026-03-30 12:23:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4 with identifier: SB09763
2026-03-30 12:23:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4 with identifier: SB09763
2026-03-30 12:23:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4 with identifier: SB09763 to the API
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:12:13Z',
 'fuel_type': 'petrol',
 'id': 'dd9dc4ce-6d6c-5693-bd61-48c2464ba2b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB09763',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 183098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-28',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2006}
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB09763%27 HTTP/1.1" 200 None
2026-03-30 12:23:41 [auto1.nl] INFO: Saving data for SB09763: {'auction_closing_time': 1774969933.0, 'created_time': 1774354325.657926, 'last_price_update_time': 1774873421.713651}
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SB09763') HTTP/1.1" 204 0
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-30 12:23:41 [auto1.nl] INFO: Found listing with ID: PK96400
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK96400%27 HTTP/1.1" 200 None
2026-03-30 12:23:41 [auto1.nl] INFO: Scrape type for PK96400: 2
2026-03-30 12:23:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e6da06-9003-5625-92d4-19fddc3b4b2f with identifier: PK96400
2026-03-30 12:23:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e6da06-9003-5625-92d4-19fddc3b4b2f with scrape type 2
2026-03-30 12:23:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e6da06-9003-5625-92d4-19fddc3b4b2f with scrape type 2
2026-03-30 12:23:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 47e6da06-9003-5625-92d4-19fddc3b4b2f, identifier: PK96400
2026-03-30 12:23:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 47e6da06-9003-5625-92d4-19fddc3b4b2f with identifier: PK96400
2026-03-30 12:23:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 47e6da06-9003-5625-92d4-19fddc3b4b2f with identifier: PK96400
2026-03-30 12:23:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 47e6da06-9003-5625-92d4-19fddc3b4b2f with identifier: PK96400 to the API
2026-03-30 12:23:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:19:11Z',
 'fuel_type': 'petrol',
 'id': '47e6da06-9003-5625-92d4-19fddc3b4b2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK96400',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 150964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK96400%27 HTTP/1.1" 200 None
2026-03-30 12:23:42 [auto1.nl] INFO: Saving data for PK96400: {'auction_closing_time': 1774970351.0, 'created_time': 1774379626.248247, 'last_price_update_time': 1774873422.149085}
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK96400') HTTP/1.1" 204 0
2026-03-30 12:23:42 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-30 12:23:42 [auto1.nl] INFO: Scrape type for EP01312: 2
2026-03-30 12:23:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312
2026-03-30 12:23:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b083c7-3431-5cb0-9ab3-606c38d02ccd with scrape type 2
2026-03-30 12:23:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48b083c7-3431-5cb0-9ab3-606c38d02ccd with scrape type 2
2026-03-30 12:23:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 48b083c7-3431-5cb0-9ab3-606c38d02ccd, identifier: EP01312
2026-03-30 12:23:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312
2026-03-30 12:23:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312
2026-03-30 12:23:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 48b083c7-3431-5cb0-9ab3-606c38d02ccd with identifier: EP01312 to the API
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:54:03Z',
 'fuel_type': 'diesel',
 'id': '48b083c7-3431-5cb0-9ab3-606c38d02ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP01312',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 341505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-04',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-30 12:23:42 [auto1.nl] INFO: Saving data for EP01312: {'auction_closing_time': 1774972443.0, 'created_time': 1774465823.660366, 'last_price_update_time': 1774873422.691697}
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP01312') HTTP/1.1" 204 0
2026-03-30 12:23:42 [auto1.nl] INFO: Found listing with ID: SH83411
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SH83411%27 HTTP/1.1" 200 None
2026-03-30 12:23:42 [auto1.nl] INFO: Scrape type for SH83411: 2
2026-03-30 12:23:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46cf2036-19db-559a-adb8-db998674c18e with identifier: SH83411
2026-03-30 12:23:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46cf2036-19db-559a-adb8-db998674c18e with scrape type 2
2026-03-30 12:23:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46cf2036-19db-559a-adb8-db998674c18e with scrape type 2
2026-03-30 12:23:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46cf2036-19db-559a-adb8-db998674c18e, identifier: SH83411
2026-03-30 12:23:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46cf2036-19db-559a-adb8-db998674c18e with identifier: SH83411
2026-03-30 12:23:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46cf2036-19db-559a-adb8-db998674c18e with identifier: SH83411
2026-03-30 12:23:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46cf2036-19db-559a-adb8-db998674c18e with identifier: SH83411 to the API
2026-03-30 12:23:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:58:01Z',
 'fuel_type': 'petrol',
 'id': '46cf2036-19db-559a-adb8-db998674c18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH83411',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 149305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-13',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SH83411%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [auto1.nl] INFO: Saving data for SH83411: {'auction_closing_time': 1774972681.0, 'created_time': 1773134123.937526, 'last_price_update_time': 1774873423.180897}
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SH83411') HTTP/1.1" 204 0
2026-03-30 12:23:43 [auto1.nl] INFO: Found listing with ID: LF57152
2026-03-30 12:23:43 [auto1.nl] INFO: Found listing with ID: NJ28414
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ28414%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [auto1.nl] INFO: Scrape type for NJ28414: 2
2026-03-30 12:23:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a130d316-ba50-5814-b9da-884e3565f744 with identifier: NJ28414
2026-03-30 12:23:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a130d316-ba50-5814-b9da-884e3565f744 with scrape type 2
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a130d316-ba50-5814-b9da-884e3565f744 with scrape type 2
2026-03-30 12:23:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a130d316-ba50-5814-b9da-884e3565f744, identifier: NJ28414
2026-03-30 12:23:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a130d316-ba50-5814-b9da-884e3565f744 with identifier: NJ28414
2026-03-30 12:23:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a130d316-ba50-5814-b9da-884e3565f744 with identifier: NJ28414
2026-03-30 12:23:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a130d316-ba50-5814-b9da-884e3565f744 with identifier: NJ28414 to the API
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-31T15:18:29Z',
 'fuel_type': 'hybrid',
 'id': 'a130d316-ba50-5814-b9da-884e3565f744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ28414',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 309292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-09',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2015}
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ28414%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [auto1.nl] INFO: Saving data for NJ28414: {'auction_closing_time': 1774970309.0, 'created_time': 1773131950.291243, 'last_price_update_time': 1774873423.647708}
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ28414') HTTP/1.1" 204 0
2026-03-30 12:23:43 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [auto1.nl] INFO: Scrape type for XA55617: 2
2026-03-30 12:23:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617
2026-03-30 12:23:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with scrape type 2
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with scrape type 2
2026-03-30 12:23:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ef1c8856-9155-5260-8e16-8d1b0f1e39e6, identifier: XA55617
2026-03-30 12:23:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617
2026-03-30 12:23:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617
2026-03-30 12:23:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ef1c8856-9155-5260-8e16-8d1b0f1e39e6 with identifier: XA55617 to the API
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:19:39Z',
 'fuel_type': 'petrol',
 'id': 'ef1c8856-9155-5260-8e16-8d1b0f1e39e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA55617',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 111176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-30 12:23:44 [auto1.nl] INFO: Saving data for XA55617: {'auction_closing_time': 1774970379.0, 'created_time': 1773134718.982045, 'last_price_update_time': 1774873424.103066}
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XA55617') HTTP/1.1" 204 0
2026-03-30 12:23:44 [auto1.nl] INFO: Found listing with ID: PY04888
2026-03-30 12:23:44 [auto1.nl] INFO: Found listing with ID: AA50190
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA50190%27 HTTP/1.1" 200 None
2026-03-30 12:23:44 [auto1.nl] INFO: Scrape type for AA50190: 2
2026-03-30 12:23:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7af23cb9-72e8-5a45-8d2c-24a46bce4489 with identifier: AA50190
2026-03-30 12:23:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7af23cb9-72e8-5a45-8d2c-24a46bce4489 with scrape type 2
2026-03-30 12:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7af23cb9-72e8-5a45-8d2c-24a46bce4489 with scrape type 2
2026-03-30 12:23:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7af23cb9-72e8-5a45-8d2c-24a46bce4489, identifier: AA50190
2026-03-30 12:23:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7af23cb9-72e8-5a45-8d2c-24a46bce4489 with identifier: AA50190
2026-03-30 12:23:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7af23cb9-72e8-5a45-8d2c-24a46bce4489 with identifier: AA50190
2026-03-30 12:23:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7af23cb9-72e8-5a45-8d2c-24a46bce4489 with identifier: AA50190 to the API
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:02:43Z',
 'fuel_type': 'petrol',
 'id': '7af23cb9-72e8-5a45-8d2c-24a46bce4489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA50190',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 111218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2020}
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA50190%27 HTTP/1.1" 200 None
2026-03-30 12:23:44 [auto1.nl] INFO: Saving data for AA50190: {'auction_closing_time': 1774969363.0, 'created_time': 1774379628.079004, 'last_price_update_time': 1774873424.544284}
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AA50190') HTTP/1.1" 204 0
2026-03-30 12:23:44 [auto1.nl] INFO: Found listing with ID: BR90130
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR90130%27 HTTP/1.1" 200 None
2026-03-30 12:23:44 [auto1.nl] INFO: Scrape type for BR90130: 2
2026-03-30 12:23:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34441108-d70f-51e8-b3d3-6e5c35308ce0 with identifier: BR90130
2026-03-30 12:23:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34441108-d70f-51e8-b3d3-6e5c35308ce0 with scrape type 2
2026-03-30 12:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34441108-d70f-51e8-b3d3-6e5c35308ce0 with scrape type 2
2026-03-30 12:23:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34441108-d70f-51e8-b3d3-6e5c35308ce0, identifier: BR90130
2026-03-30 12:23:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34441108-d70f-51e8-b3d3-6e5c35308ce0 with identifier: BR90130
2026-03-30 12:23:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34441108-d70f-51e8-b3d3-6e5c35308ce0 with identifier: BR90130
2026-03-30 12:23:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34441108-d70f-51e8-b3d3-6e5c35308ce0 with identifier: BR90130 to the API
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:03:03Z',
 'fuel_type': 'petrol',
 'id': '34441108-d70f-51e8-b3d3-6e5c35308ce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR90130',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 243523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.4 Multispace Plus',
 'transmission': 'manual',
 'trim': 'Multispace Plus',
 'year': 2006}
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR90130%27 HTTP/1.1" 200 None
2026-03-30 12:23:44 [auto1.nl] INFO: Saving data for BR90130: {'auction_closing_time': 1774969383.0, 'created_time': 1774354588.782014, 'last_price_update_time': 1774873424.997886}
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BR90130') HTTP/1.1" 204 0
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: TX69728
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: NX43694
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX43694%27 HTTP/1.1" 200 None
2026-03-30 12:23:45 [auto1.nl] INFO: Scrape type for NX43694: 1
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: TA42308
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-30 12:23:45 [auto1.nl] INFO: Scrape type for RF26708: 2
2026-03-30 12:23:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708
2026-03-30 12:23:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade7b98b-d354-575f-b736-9eac58d801e4 with scrape type 2
2026-03-30 12:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade7b98b-d354-575f-b736-9eac58d801e4 with scrape type 2
2026-03-30 12:23:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ade7b98b-d354-575f-b736-9eac58d801e4, identifier: RF26708
2026-03-30 12:23:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708
2026-03-30 12:23:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708
2026-03-30 12:23:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ade7b98b-d354-575f-b736-9eac58d801e4 with identifier: RF26708 to the API
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:05:11Z',
 'fuel_type': 'petrol',
 'id': 'ade7b98b-d354-575f-b736-9eac58d801e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF26708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 231432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Track & Field 4Motion',
 'transmission': 'manual',
 'trim': 'Track & Field 4Motion',
 'year': 2014}
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-30 12:23:45 [auto1.nl] INFO: Saving data for RF26708: {'auction_closing_time': 1774969511.0, 'created_time': 1773343015.919708, 'last_price_update_time': 1774873425.517038}
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF26708') HTTP/1.1" 204 0
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: GW12777
2026-03-30 12:23:45 [auto1.nl] INFO: Found listing with ID: ZE62663
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE62663%27 HTTP/1.1" 200 None
2026-03-30 12:23:45 [auto1.nl] INFO: Scrape type for ZE62663: 2
2026-03-30 12:23:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f753712-5df7-5724-ad83-87e1b7c25956 with identifier: ZE62663
2026-03-30 12:23:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f753712-5df7-5724-ad83-87e1b7c25956 with scrape type 2
2026-03-30 12:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f753712-5df7-5724-ad83-87e1b7c25956 with scrape type 2
2026-03-30 12:23:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9f753712-5df7-5724-ad83-87e1b7c25956, identifier: ZE62663
2026-03-30 12:23:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9f753712-5df7-5724-ad83-87e1b7c25956 with identifier: ZE62663
2026-03-30 12:23:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9f753712-5df7-5724-ad83-87e1b7c25956 with identifier: ZE62663
2026-03-30 12:23:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9f753712-5df7-5724-ad83-87e1b7c25956 with identifier: ZE62663 to the API
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:54:19Z',
 'fuel_type': 'petrol',
 'id': '9f753712-5df7-5724-ad83-87e1b7c25956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE62663',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 127176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE62663%27 HTTP/1.1" 200 None
2026-03-30 12:23:46 [auto1.nl] INFO: Saving data for ZE62663: {'auction_closing_time': 1774972459.0, 'created_time': 1773947467.509258, 'last_price_update_time': 1774873426.079503}
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE62663') HTTP/1.1" 204 0
2026-03-30 12:23:46 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-30 12:23:46 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-30 12:23:46 [auto1.nl] INFO: Scrape type for EH98197: 2
2026-03-30 12:23:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197
2026-03-30 12:23:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec7c2416-0e43-5af1-8c75-83731f574c85 with scrape type 2
2026-03-30 12:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec7c2416-0e43-5af1-8c75-83731f574c85 with scrape type 2
2026-03-30 12:23:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ec7c2416-0e43-5af1-8c75-83731f574c85, identifier: EH98197
2026-03-30 12:23:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG57032/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197
2026-03-30 12:23:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197
2026-03-30 12:23:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197 to the API
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:48:11Z',
 'fuel_type': 'hybrid',
 'id': 'ec7c2416-0e43-5af1-8c75-83731f574c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH98197',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 32683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-30 12:23:46 [auto1.nl] INFO: Saving data for EH98197: {'auction_closing_time': 1774972091.0, 'created_time': 1774465988.030663, 'last_price_update_time': 1774873426.539466}
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH98197') HTTP/1.1" 204 0
2026-03-30 12:23:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:46 [auto1.nl] INFO: Found listing with ID: GE59492
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE59492%27 HTTP/1.1" 200 None
2026-03-30 12:23:46 [auto1.nl] INFO: Scrape type for GE59492: 2
2026-03-30 12:23:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd493b5-0dfe-5a76-9a79-7e9a93e3f263 with identifier: GE59492
2026-03-30 12:23:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd493b5-0dfe-5a76-9a79-7e9a93e3f263 with scrape type 2
2026-03-30 12:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd493b5-0dfe-5a76-9a79-7e9a93e3f263 with scrape type 2
2026-03-30 12:23:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2bd493b5-0dfe-5a76-9a79-7e9a93e3f263, identifier: GE59492
2026-03-30 12:23:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2bd493b5-0dfe-5a76-9a79-7e9a93e3f263 with identifier: GE59492
2026-03-30 12:23:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2bd493b5-0dfe-5a76-9a79-7e9a93e3f263 with identifier: GE59492
2026-03-30 12:23:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2bd493b5-0dfe-5a76-9a79-7e9a93e3f263 with identifier: GE59492 to the API
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-31T15:14:45Z',
 'fuel_type': 'hybrid',
 'id': '2bd493b5-0dfe-5a76-9a79-7e9a93e3f263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE59492',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 122943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-05',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE59492%27 HTTP/1.1" 200 None
2026-03-30 12:23:46 [auto1.nl] INFO: Saving data for GE59492: {'auction_closing_time': 1774970085.0, 'created_time': 1774293097.330812, 'last_price_update_time': 1774873426.984237}
2026-03-30 12:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GE59492') HTTP/1.1" 204 0
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: UU65175
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: XC64033
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: GE92727
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE92727%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [auto1.nl] INFO: Scrape type for GE92727: 1
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: XE20082
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XE20082%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [auto1.nl] INFO: Scrape type for XE20082: 1
2026-03-30 12:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA01556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: BZ97098
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: NH87974
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [auto1.nl] INFO: Scrape type for TS92650: 2
2026-03-30 12:23:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650
2026-03-30 12:23:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b161ce3-5818-5169-ba67-b66351309894 with scrape type 2
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b161ce3-5818-5169-ba67-b66351309894 with scrape type 2
2026-03-30 12:23:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1b161ce3-5818-5169-ba67-b66351309894, identifier: TS92650
2026-03-30 12:23:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650
2026-03-30 12:23:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650
2026-03-30 12:23:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1b161ce3-5818-5169-ba67-b66351309894 with identifier: TS92650 to the API
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:03:12Z',
 'fuel_type': 'petrol',
 'id': '1b161ce3-5818-5169-ba67-b66351309894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS92650',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 109576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [auto1.nl] INFO: Saving data for TS92650: {'auction_closing_time': 1774969392.0, 'created_time': 1774440667.637441, 'last_price_update_time': 1774873427.48482}
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TS92650') HTTP/1.1" 204 0
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-30 12:23:47 [auto1.nl] INFO: Found listing with ID: UX71123
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UX71123%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [auto1.nl] INFO: Scrape type for UX71123: 2
2026-03-30 12:23:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62cd1007-9f91-5b67-8184-59c2c97aca31 with identifier: UX71123
2026-03-30 12:23:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62cd1007-9f91-5b67-8184-59c2c97aca31 with scrape type 2
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62cd1007-9f91-5b67-8184-59c2c97aca31 with scrape type 2
2026-03-30 12:23:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 62cd1007-9f91-5b67-8184-59c2c97aca31, identifier: UX71123
2026-03-30 12:23:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 62cd1007-9f91-5b67-8184-59c2c97aca31 with identifier: UX71123
2026-03-30 12:23:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 62cd1007-9f91-5b67-8184-59c2c97aca31 with identifier: UX71123
2026-03-30 12:23:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 62cd1007-9f91-5b67-8184-59c2c97aca31 with identifier: UX71123 to the API
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:36:38Z',
 'fuel_type': 'petrol',
 'id': '62cd1007-9f91-5b67-8184-59c2c97aca31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX71123',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 266340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-25',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Blue',
 'transmission': 'manual',
 'trim': 'Blue',
 'year': 2009}
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UX71123%27 HTTP/1.1" 200 None
2026-03-30 12:23:48 [auto1.nl] INFO: Saving data for UX71123: {'auction_closing_time': 1774971398.0, 'created_time': 1774293112.519, 'last_price_update_time': 1774873428.025134}
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UX71123') HTTP/1.1" 204 0
2026-03-30 12:23:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ50743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE40688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK91106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:07 [scrapy.extensions.logstats] INFO: Crawled 88 pages (at 12 pages/min), scraped 64 items (at 21 items/min)
2026-03-30 12:24:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU09064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK69349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF84926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY41956> (referer: https://www.auto1.com/v1/car-details-view/KY41956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2929fcb-c83c-53ca-ab24-e13e492a45f3 with identifier: KY41956
2026-03-30 12:24:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2929fcb-c83c-53ca-ab24-e13e492a45f3 with scrape type 1
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2929fcb-c83c-53ca-ab24-e13e492a45f3
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_122dcae8260c67976d7d038c7a011bf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_122dcae8260c67976d7d038c7a011bf8.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_8555f45c41721e526df8421acb161689.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_8555f45c41721e526df8421acb161689.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_366c6997096c4a89537a306c39cb0ab3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_366c6997096c4a89537a306c39cb0ab3.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_5ba6a515a20e2b3798ea43c87a87b300.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_5ba6a515a20e2b3798ea43c87a87b300.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_06cc3dc24af10e7a987b793e85be00c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_06cc3dc24af10e7a987b793e85be00c3.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_b3ab7e6aeb63563db5ddeb741c34b753.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_b3ab7e6aeb63563db5ddeb741c34b753.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_36a3120fa95b37bcccc08da524a5967b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_36a3120fa95b37bcccc08da524a5967b.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_49e09d3ad69f6b2964e4b7dcf6ddb731.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_49e09d3ad69f6b2964e4b7dcf6ddb731.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_0dac5e2455cdeccac38b2011575245a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_0dac5e2455cdeccac38b2011575245a0.jpg already downloaded
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F8b%252F588b68c319969b9c8191fe4bcb2571dc%252Fpa%252FKY41956_70c133dcdd1e700fdea276221390e830.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_70c133dcdd1e700fdea276221390e830.jpg already downloaded
2026-03-30 12:24:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c2929fcb-c83c-53ca-ab24-e13e492a45f3, identifier: KY41956
2026-03-30 12:24:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c2929fcb-c83c-53ca-ab24-e13e492a45f3 with identifier: KY41956
2026-03-30 12:24:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c2929fcb-c83c-53ca-ab24-e13e492a45f3 with identifier: KY41956
2026-03-30 12:24:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c2929fcb-c83c-53ca-ab24-e13e492a45f3 with identifier: KY41956 to the API
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY41956>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:38:20Z',
 'fuel_type': 'petrol',
 'id': 'c2929fcb-c83c-53ca-ab24-e13e492a45f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NV726X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY41956',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 255395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_122dcae8260c67976d7d038c7a011bf8.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_8555f45c41721e526df8421acb161689.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_366c6997096c4a89537a306c39cb0ab3.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_5ba6a515a20e2b3798ea43c87a87b300.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_06cc3dc24af10e7a987b793e85be00c3.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_b3ab7e6aeb63563db5ddeb741c34b753.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_36a3120fa95b37bcccc08da524a5967b.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_49e09d3ad69f6b2964e4b7dcf6ddb731.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_0dac5e2455cdeccac38b2011575245a0.jpg',
                'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_70c133dcdd1e700fdea276221390e830.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_122dcae8260c67976d7d038c7a011bf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_8555f45c41721e526df8421acb161689.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2088826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_366c6997096c4a89537a306c39cb0ab3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_5ba6a515a20e2b3798ea43c87a87b300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1948966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_06cc3dc24af10e7a987b793e85be00c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_b3ab7e6aeb63563db5ddeb741c34b753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_36a3120fa95b37bcccc08da524a5967b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_49e09d3ad69f6b2964e4b7dcf6ddb731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2120769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_0dac5e2455cdeccac38b2011575245a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2929fcb-c83c-53ca-ab24-e13e492a45f3/c2929fcb-c83c-53ca-ab24-e13e492a45f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2264641,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/8b/588b68c319969b9c8191fe4bcb2571dc/pa/KY41956_70c133dcdd1e700fdea276221390e830.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KY41956%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [auto1.nl] INFO: Saving data for KY41956: {'created_time': 1774873459.753071, 'last_price_update_time': 1774873459.753082, 'auction_closing_time': 1774971500.0}
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KY41956') HTTP/1.1" 204 0
2026-03-30 12:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH07415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE20082/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA01556> (referer: https://www.auto1.com/v1/car-details-view/GA01556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a87c99e2-2c6f-5a6c-b982-40ffc74ab709 with identifier: GA01556
2026-03-30 12:24:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709 with scrape type 1
2026-03-30 12:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_383821c693ff39e062315cfd01ea330f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_383821c693ff39e062315cfd01ea330f.jpg not downloaded yet
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_19bc47679c05110a8e21c0361c2303ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_19bc47679c05110a8e21c0361c2303ef.jpg not downloaded yet
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_9f2d9918f3fa53329f6e228df5f02c90.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_9f2d9918f3fa53329f6e228df5f02c90.jpg not downloaded yet
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_4dbee875af2bea56d5a22f3f47733226.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_4dbee875af2bea56d5a22f3f47733226.jpg not downloaded yet
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_3cd781cf7b344872ee67e3a12fabd764.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_3cd781cf7b344872ee67e3a12fabd764.jpg not downloaded yet
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ50743> (referer: https://www.auto1.com/v1/car-details-view/BZ50743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT02482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 250a3a0f-2a04-5a0a-b4b7-e415b60895db with identifier: BZ50743
2026-03-30 12:24:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db with scrape type 1
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_02d77314dad2cd344fc3124c28805038.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_02d77314dad2cd344fc3124c28805038.jpg not downloaded yet
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_a53e58387e6f648e86918ac78a93b3bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_a53e58387e6f648e86918ac78a93b3bc.jpg not downloaded yet
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_10af1651cdd6093fd4ea17a1e42cfc70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_10af1651cdd6093fd4ea17a1e42cfc70.jpg not downloaded yet
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_8d2050ce700e5d354116be81bfc83204.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_8d2050ce700e5d354116be81bfc83204.jpg not downloaded yet
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_ec0d9ce8a330dc3d1be0b682a135f9c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_ec0d9ce8a330dc3d1be0b682a135f9c8.jpg not downloaded yet
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_d25b67f0bb2b464af53e6af2361e72cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_d25b67f0bb2b464af53e6af2361e72cf.jpg not downloaded yet
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_3cd781cf7b344872ee67e3a12fabd764.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60ce310>
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_3cd781cf7b344872ee67e3a12fabd764.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_3cd781cf7b344872ee67e3a12fabd764.jpg saved to cache
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_4dbee875af2bea56d5a22f3f47733226.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_d25b67f0bb2b464af53e6af2361e72cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_ec0d9ce8a330dc3d1be0b682a135f9c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f1fbd0>
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_4dbee875af2bea56d5a22f3f47733226.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_4dbee875af2bea56d5a22f3f47733226.jpg saved to cache
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60de490>
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_d25b67f0bb2b464af53e6af2361e72cf.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_d25b67f0bb2b464af53e6af2361e72cf.jpg saved to cache
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60a1890>
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_ec0d9ce8a330dc3d1be0b682a135f9c8.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_ec0d9ce8a330dc3d1be0b682a135f9c8.jpg saved to cache
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_8d2050ce700e5d354116be81bfc83204.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_10af1651cdd6093fd4ea17a1e42cfc70.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aeafd0>
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_8d2050ce700e5d354116be81bfc83204.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_8d2050ce700e5d354116be81bfc83204.jpg saved to cache
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f81410>
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_10af1651cdd6093fd4ea17a1e42cfc70.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_10af1651cdd6093fd4ea17a1e42cfc70.jpg saved to cache
2026-03-30 12:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db
2026-03-30 12:24:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_a53e58387e6f648e86918ac78a93b3bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_02d77314dad2cd344fc3124c28805038.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_9f2d9918f3fa53329f6e228df5f02c90.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a85950>
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_a53e58387e6f648e86918ac78a93b3bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_a53e58387e6f648e86918ac78a93b3bc.jpg saved to cache
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f2a810>
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F58%252F80582cefef53b6ec2f1664f8997bc36f%252Fpa%252FBZ50743_02d77314dad2cd344fc3124c28805038.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_02d77314dad2cd344fc3124c28805038.jpg saved to cache
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db
2026-03-30 12:24:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 250a3a0f-2a04-5a0a-b4b7-e415b60895db, skipping ID generation
2026-03-30 12:24:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db with scrape type 1
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 250a3a0f-2a04-5a0a-b4b7-e415b60895db sending to next pipeline
2026-03-30 12:24:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 250a3a0f-2a04-5a0a-b4b7-e415b60895db, identifier: BZ50743
2026-03-30 12:24:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 250a3a0f-2a04-5a0a-b4b7-e415b60895db with identifier: BZ50743
2026-03-30 12:24:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 250a3a0f-2a04-5a0a-b4b7-e415b60895db with identifier: BZ50743
2026-03-30 12:24:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 250a3a0f-2a04-5a0a-b4b7-e415b60895db with identifier: BZ50743 to the API
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_02d77314dad2cd344fc3124c28805038.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:42:50Z',
 'fuel_type': 'petrol',
 'id': '250a3a0f-2a04-5a0a-b4b7-e415b60895db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '84-RNH-4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ50743',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 219371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_02d77314dad2cd344fc3124c28805038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_a53e58387e6f648e86918ac78a93b3bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_10af1651cdd6093fd4ea17a1e42cfc70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_8d2050ce700e5d354116be81bfc83204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_ec0d9ce8a330dc3d1be0b682a135f9c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250a3a0f-2a04-5a0a-b4b7-e415b60895db/250a3a0f-2a04-5a0a-b4b7-e415b60895db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/58/80582cefef53b6ec2f1664f8997bc36f/pa/BZ50743_d25b67f0bb2b464af53e6af2361e72cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ50743%27 HTTP/1.1" 200 None
2026-03-30 12:24:32 [auto1.nl] INFO: Saving data for BZ50743: {'created_time': 1774873472.806798, 'last_price_update_time': 1774873472.80681, 'auction_closing_time': 1774971770.0}
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ50743') HTTP/1.1" 204 0
2026-03-30 12:24:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_19bc47679c05110a8e21c0361c2303ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f38d50>
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_9f2d9918f3fa53329f6e228df5f02c90.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_9f2d9918f3fa53329f6e228df5f02c90.jpg saved to cache
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcd29410>
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_19bc47679c05110a8e21c0361c2303ef.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_19bc47679c05110a8e21c0361c2303ef.jpg saved to cache
2026-03-30 12:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709
2026-03-30 12:24:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_383821c693ff39e062315cfd01ea330f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbea5d0>
2026-03-30 12:24:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fcf%252Fb3cf5c7fc4ab3c7d8097b53b0c47e300%252Fpa%252FGA01556_383821c693ff39e062315cfd01ea330f.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_383821c693ff39e062315cfd01ea330f.jpg saved to cache
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709
2026-03-30 12:24:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a87c99e2-2c6f-5a6c-b982-40ffc74ab709, skipping ID generation
2026-03-30 12:24:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709 with scrape type 1
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a87c99e2-2c6f-5a6c-b982-40ffc74ab709 sending to next pipeline
2026-03-30 12:24:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a87c99e2-2c6f-5a6c-b982-40ffc74ab709, identifier: GA01556
2026-03-30 12:24:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a87c99e2-2c6f-5a6c-b982-40ffc74ab709 with identifier: GA01556
2026-03-30 12:24:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a87c99e2-2c6f-5a6c-b982-40ffc74ab709 with identifier: GA01556
2026-03-30 12:24:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a87c99e2-2c6f-5a6c-b982-40ffc74ab709 with identifier: GA01556 to the API
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_383821c693ff39e062315cfd01ea330f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 182,
 'expiration_date': '2026-03-31T15:07:47Z',
 'fuel_type': 'petrol',
 'id': 'a87c99e2-2c6f-5a6c-b982-40ffc74ab709',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '27XFS5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA01556',
 'listing': 'auction',
 'location': 'NL, Almere',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 251373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_383821c693ff39e062315cfd01ea330f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_19bc47679c05110a8e21c0361c2303ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_9f2d9918f3fa53329f6e228df5f02c90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_4dbee875af2bea56d5a22f3f47733226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a87c99e2-2c6f-5a6c-b982-40ffc74ab709/a87c99e2-2c6f-5a6c-b982-40ffc74ab709_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/cf/b3cf5c7fc4ab3c7d8097b53b0c47e300/pa/GA01556_3cd781cf7b344872ee67e3a12fabd764.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA01556%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [auto1.nl] INFO: Saving data for GA01556: {'created_time': 1774873473.598804, 'last_price_update_time': 1774873473.598817, 'auction_closing_time': 1774969667.0}
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA01556') HTTP/1.1" 204 0
2026-03-30 12:24:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE40688> (referer: https://www.auto1.com/v1/car-details-view/SE40688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b61843-2f3c-5ad8-9f41-de696326a1e9 with identifier: SE40688
2026-03-30 12:24:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b61843-2f3c-5ad8-9f41-de696326a1e9 with scrape type 1
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_1a3bc890706a33947d6d1af7ed618e38.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_1a3bc890706a33947d6d1af7ed618e38.jpg not downloaded yet
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_ba748f6b4d1baa3b1e215786d035619d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ba748f6b4d1baa3b1e215786d035619d.jpg not downloaded yet
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_bdcf07de313938134d61b1621d9f2ba1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_bdcf07de313938134d61b1621d9f2ba1.jpg not downloaded yet
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_5cc61738c2f8a5166d836cfd77616756.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5cc61738c2f8a5166d836cfd77616756.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_ea6cfc4590e1c56df852d8026b2defac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ea6cfc4590e1c56df852d8026b2defac.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_5eae091def42d0f8aca44969434eb82b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5eae091def42d0f8aca44969434eb82b.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_eae3ca3f4b9224e9340b0f85372f6bb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_eae3ca3f4b9224e9340b0f85372f6bb1.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_d4fc85cce4d5b218fc6b753ce4f982b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_d4fc85cce4d5b218fc6b753ce4f982b1.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_8e636ff0c27654fee88a37dd23f1a9f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_8e636ff0c27654fee88a37dd23f1a9f3.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_7733fb2bceea99770ecfd4c0028e6508.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_7733fb2bceea99770ecfd4c0028e6508.jpg not downloaded yet
2026-03-30 12:24:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK91106> (referer: https://www.auto1.com/v1/car-details-view/HK91106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_7733fb2bceea99770ecfd4c0028e6508.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b with identifier: HK91106
2026-03-30 12:24:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b with scrape type 1
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_fee92f7a0a9981fd2c1ce51dc012176f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_fee92f7a0a9981fd2c1ce51dc012176f.jpg not downloaded yet
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_3d76dfe5896217b831cfe06edf01fb8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_3d76dfe5896217b831cfe06edf01fb8e.jpg not downloaded yet
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_4eb6a131d7d0e31143139b3b55889cb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_4eb6a131d7d0e31143139b3b55889cb8.jpg not downloaded yet
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_ecc3d8e2c94ba657a27dc5ef68dbd97e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_ecc3d8e2c94ba657a27dc5ef68dbd97e.jpg not downloaded yet
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f38410>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_7733fb2bceea99770ecfd4c0028e6508.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_7733fb2bceea99770ecfd4c0028e6508.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_56a04891c4a7086fb801e980c47cb139.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_56a04891c4a7086fb801e980c47cb139.jpg not downloaded yet
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_8e636ff0c27654fee88a37dd23f1a9f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_7b412b2c4f2352bd0cd7f14003d34b28.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_7b412b2c4f2352bd0cd7f14003d34b28.jpg not downloaded yet
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_ecc3d8e2c94ba657a27dc5ef68dbd97e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ad2c90>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_8e636ff0c27654fee88a37dd23f1a9f3.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_8e636ff0c27654fee88a37dd23f1a9f3.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d694b0d0>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_ecc3d8e2c94ba657a27dc5ef68dbd97e.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_ecc3d8e2c94ba657a27dc5ef68dbd97e.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_7b412b2c4f2352bd0cd7f14003d34b28.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_56a04891c4a7086fb801e980c47cb139.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6039090>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_7b412b2c4f2352bd0cd7f14003d34b28.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_7b412b2c4f2352bd0cd7f14003d34b28.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f72b90>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_56a04891c4a7086fb801e980c47cb139.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_56a04891c4a7086fb801e980c47cb139.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_4eb6a131d7d0e31143139b3b55889cb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_3d76dfe5896217b831cfe06edf01fb8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_fee92f7a0a9981fd2c1ce51dc012176f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603a510>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_4eb6a131d7d0e31143139b3b55889cb8.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_4eb6a131d7d0e31143139b3b55889cb8.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b
2026-03-30 12:24:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_d4fc85cce4d5b218fc6b753ce4f982b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aa3750>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_3d76dfe5896217b831cfe06edf01fb8e.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_3d76dfe5896217b831cfe06edf01fb8e.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f69d10>
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F80%252F6c80e294b98c4a084ee76da4ebf1f63b%252Fpa%252FHK91106_fee92f7a0a9981fd2c1ce51dc012176f.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_fee92f7a0a9981fd2c1ce51dc012176f.jpg saved to cache
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b
2026-03-30 12:24:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b, skipping ID generation
2026-03-30 12:24:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b with scrape type 1
2026-03-30 12:24:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b sending to next pipeline
2026-03-30 12:24:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b, identifier: HK91106
2026-03-30 12:24:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b with identifier: HK91106
2026-03-30 12:24:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b with identifier: HK91106
2026-03-30 12:24:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b with identifier: HK91106 to the API
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_fee92f7a0a9981fd2c1ce51dc012176f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:24:24Z',
 'fuel_type': 'petrol',
 'id': '30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '88GZD2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK91106',
 'listing': 'auction',
 'location': 'NL, Koog aan de Zaan',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 143064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_fee92f7a0a9981fd2c1ce51dc012176f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_3d76dfe5896217b831cfe06edf01fb8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_4eb6a131d7d0e31143139b3b55889cb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_ecc3d8e2c94ba657a27dc5ef68dbd97e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_56a04891c4a7086fb801e980c47cb139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b/30bc3a00-d0bb-5db2-8c7f-97d9ac874a7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/80/6c80e294b98c4a084ee76da4ebf1f63b/pa/HK91106_7b412b2c4f2352bd0cd7f14003d34b28.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK91106%27 HTTP/1.1" 200 None
2026-03-30 12:24:37 [auto1.nl] INFO: Saving data for HK91106: {'created_time': 1774873477.430168, 'last_price_update_time': 1774873477.43018, 'auction_closing_time': 1774970664.0}
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK91106') HTTP/1.1" 204 0
2026-03-30 12:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_eae3ca3f4b9224e9340b0f85372f6bb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f7ffd0>
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_d4fc85cce4d5b218fc6b753ce4f982b1.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_d4fc85cce4d5b218fc6b753ce4f982b1.jpg saved to cache
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5eae091def42d0f8aca44969434eb82b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f3ba90>
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_eae3ca3f4b9224e9340b0f85372f6bb1.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_eae3ca3f4b9224e9340b0f85372f6bb1.jpg saved to cache
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60b8690>
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_5eae091def42d0f8aca44969434eb82b.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5eae091def42d0f8aca44969434eb82b.jpg saved to cache
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ea6cfc4590e1c56df852d8026b2defac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5cc61738c2f8a5166d836cfd77616756.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60faa50>
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_ea6cfc4590e1c56df852d8026b2defac.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ea6cfc4590e1c56df852d8026b2defac.jpg saved to cache
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_bdcf07de313938134d61b1621d9f2ba1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c5410>
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_5cc61738c2f8a5166d836cfd77616756.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5cc61738c2f8a5166d836cfd77616756.jpg saved to cache
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ba748f6b4d1baa3b1e215786d035619d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_1a3bc890706a33947d6d1af7ed618e38.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d605bc50>
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_bdcf07de313938134d61b1621d9f2ba1.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_bdcf07de313938134d61b1621d9f2ba1.jpg saved to cache
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f71e50>
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_ba748f6b4d1baa3b1e215786d035619d.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ba748f6b4d1baa3b1e215786d035619d.jpg saved to cache
2026-03-30 12:24:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60f8b10>
2026-03-30 12:24:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fd5%252Fe1d588c1c44fbc1e734b1963f09d8bba%252Fpa%252FSE40688_1a3bc890706a33947d6d1af7ed618e38.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_1a3bc890706a33947d6d1af7ed618e38.jpg saved to cache
2026-03-30 12:24:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8b61843-2f3c-5ad8-9f41-de696326a1e9
2026-03-30 12:24:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8b61843-2f3c-5ad8-9f41-de696326a1e9, skipping ID generation
2026-03-30 12:24:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b61843-2f3c-5ad8-9f41-de696326a1e9 with scrape type 1
2026-03-30 12:24:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8b61843-2f3c-5ad8-9f41-de696326a1e9 sending to next pipeline
2026-03-30 12:24:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d8b61843-2f3c-5ad8-9f41-de696326a1e9, identifier: SE40688
2026-03-30 12:24:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d8b61843-2f3c-5ad8-9f41-de696326a1e9 with identifier: SE40688
2026-03-30 12:24:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d8b61843-2f3c-5ad8-9f41-de696326a1e9 with identifier: SE40688
2026-03-30 12:24:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d8b61843-2f3c-5ad8-9f41-de696326a1e9 with identifier: SE40688 to the API
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_1a3bc890706a33947d6d1af7ed618e38.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:50:26Z',
 'fuel_type': 'petrol',
 'id': 'd8b61843-2f3c-5ad8-9f41-de696326a1e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JJ430T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE40688',
 'listing': 'auction',
 'location': "NL, 's-Gravenzande",
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 62077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_1a3bc890706a33947d6d1af7ed618e38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ba748f6b4d1baa3b1e215786d035619d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_bdcf07de313938134d61b1621d9f2ba1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5cc61738c2f8a5166d836cfd77616756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_ea6cfc4590e1c56df852d8026b2defac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_5eae091def42d0f8aca44969434eb82b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_eae3ca3f4b9224e9340b0f85372f6bb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_d4fc85cce4d5b218fc6b753ce4f982b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_8e636ff0c27654fee88a37dd23f1a9f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b61843-2f3c-5ad8-9f41-de696326a1e9/d8b61843-2f3c-5ad8-9f41-de696326a1e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/d5/e1d588c1c44fbc1e734b1963f09d8bba/pa/SE40688_7733fb2bceea99770ecfd4c0028e6508.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2016}
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE40688%27 HTTP/1.1" 200 None
2026-03-30 12:24:38 [auto1.nl] INFO: Saving data for SE40688: {'created_time': 1774873478.583203, 'last_price_update_time': 1774873478.583217, 'auction_closing_time': 1774972226.0}
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE40688') HTTP/1.1" 204 0
2026-03-30 12:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK69349> (referer: https://www.auto1.com/v1/car-details-view/EK69349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d7822d-f2e5-5b3e-8814-66de2d9d860c with identifier: EK69349
2026-03-30 12:24:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d7822d-f2e5-5b3e-8814-66de2d9d860c with scrape type 1
2026-03-30 12:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 40d7822d-f2e5-5b3e-8814-66de2d9d860c
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ff0%252F9af04bc79e6f95478891cb14647043d6%252Fpa%252FEK69349_636320cff400e2f71b69e70285db3e28.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_636320cff400e2f71b69e70285db3e28.jpg already downloaded
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ff0%252F9af04bc79e6f95478891cb14647043d6%252Fpa%252FEK69349_0108e8a24ef64f407393c6f3c2c2ef47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_0108e8a24ef64f407393c6f3c2c2ef47.jpg already downloaded
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ff0%252F9af04bc79e6f95478891cb14647043d6%252Fpa%252FEK69349_bfba4c0e4f94f0a2ab3ba2369dfeff59.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_bfba4c0e4f94f0a2ab3ba2369dfeff59.jpg already downloaded
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ff0%252F9af04bc79e6f95478891cb14647043d6%252Fpa%252FEK69349_be3e69c2580e3a405c7794297d8bde61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_be3e69c2580e3a405c7794297d8bde61.jpg already downloaded
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Ff0%252F9af04bc79e6f95478891cb14647043d6%252Fpa%252FEK69349_45fc0e96b8c3267befaed699ca31d98e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_45fc0e96b8c3267befaed699ca31d98e.jpg already downloaded
2026-03-30 12:24:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40d7822d-f2e5-5b3e-8814-66de2d9d860c, identifier: EK69349
2026-03-30 12:24:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40d7822d-f2e5-5b3e-8814-66de2d9d860c with identifier: EK69349
2026-03-30 12:24:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40d7822d-f2e5-5b3e-8814-66de2d9d860c with identifier: EK69349
2026-03-30 12:24:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40d7822d-f2e5-5b3e-8814-66de2d9d860c with identifier: EK69349 to the API
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK69349>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:05:43Z',
 'fuel_type': 'diesel',
 'id': '40d7822d-f2e5-5b3e-8814-66de2d9d860c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '07NPN9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK69349',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 112353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_636320cff400e2f71b69e70285db3e28.jpg',
                'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_0108e8a24ef64f407393c6f3c2c2ef47.jpg',
                'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_bfba4c0e4f94f0a2ab3ba2369dfeff59.jpg',
                'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_be3e69c2580e3a405c7794297d8bde61.jpg',
                'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_45fc0e96b8c3267befaed699ca31d98e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7822d-f2e5-5b3e-8814-66de2d9d860c/40d7822d-f2e5-5b3e-8814-66de2d9d860c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_636320cff400e2f71b69e70285db3e28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7822d-f2e5-5b3e-8814-66de2d9d860c/40d7822d-f2e5-5b3e-8814-66de2d9d860c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_0108e8a24ef64f407393c6f3c2c2ef47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7822d-f2e5-5b3e-8814-66de2d9d860c/40d7822d-f2e5-5b3e-8814-66de2d9d860c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_bfba4c0e4f94f0a2ab3ba2369dfeff59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7822d-f2e5-5b3e-8814-66de2d9d860c/40d7822d-f2e5-5b3e-8814-66de2d9d860c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_be3e69c2580e3a405c7794297d8bde61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d7822d-f2e5-5b3e-8814-66de2d9d860c/40d7822d-f2e5-5b3e-8814-66de2d9d860c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/f0/9af04bc79e6f95478891cb14647043d6/pa/EK69349_45fc0e96b8c3267befaed699ca31d98e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2010}
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK69349%27 HTTP/1.1" 200 None
2026-03-30 12:24:40 [auto1.nl] INFO: Saving data for EK69349: {'created_time': 1774873480.71985, 'last_price_update_time': 1774873480.719861, 'auction_closing_time': 1774969543.0}
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK69349') HTTP/1.1" 204 0
2026-03-30 12:24:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF84926> (referer: https://www.auto1.com/v1/car-details-view/FF84926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c23f7f8-f497-5a56-afa7-f360b4435e94 with identifier: FF84926
2026-03-30 12:24:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c23f7f8-f497-5a56-afa7-f360b4435e94 with scrape type 1
2026-03-30 12:24:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0c23f7f8-f497-5a56-afa7-f360b4435e94
2026-03-30 12:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_093b9d6930465510f1e9b222336cfe54.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_093b9d6930465510f1e9b222336cfe54.jpg not downloaded yet
2026-03-30 12:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_f6566c0410fcc4221e4d0b59a274d112.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_f6566c0410fcc4221e4d0b59a274d112.jpg not downloaded yet
2026-03-30 12:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_ac9798e5e296ea68e15569e2fa1f4331.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_ac9798e5e296ea68e15569e2fa1f4331.jpg not downloaded yet
2026-03-30 12:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_399d0a47edd7857b47aa7ea1213d628c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_399d0a47edd7857b47aa7ea1213d628c.jpg not downloaded yet
2026-03-30 12:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_9e335d071f6e8d85c028f1c192cb5eb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_9e335d071f6e8d85c028f1c192cb5eb8.jpg not downloaded yet
2026-03-30 12:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_3eac0deca622fca4d9fa2a6ef1756f06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_3eac0deca622fca4d9fa2a6ef1756f06.jpg not downloaded yet
2026-03-30 12:25:07 [scrapy.extensions.logstats] INFO: Crawled 101 pages (at 13 pages/min), scraped 70 items (at 6 items/min)
2026-03-30 12:25:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX43694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_3eac0deca622fca4d9fa2a6ef1756f06.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f39c10>
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_3eac0deca622fca4d9fa2a6ef1756f06.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_3eac0deca622fca4d9fa2a6ef1756f06.jpg saved to cache
2026-03-30 12:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c23f7f8-f497-5a56-afa7-f360b4435e94
2026-03-30 12:25:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_9e335d071f6e8d85c028f1c192cb5eb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f3a350>
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_9e335d071f6e8d85c028f1c192cb5eb8.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_9e335d071f6e8d85c028f1c192cb5eb8.jpg saved to cache
2026-03-30 12:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c23f7f8-f497-5a56-afa7-f360b4435e94
2026-03-30 12:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH07415> (referer: https://www.auto1.com/v1/car-details-view/GH07415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_399d0a47edd7857b47aa7ea1213d628c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0a411e7-4336-58cb-9d03-bad0ce4aa4db with identifier: GH07415
2026-03-30 12:25:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db with scrape type 1
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_94fbcb37f862d44415d0eee0258c37a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_94fbcb37f862d44415d0eee0258c37a3.jpg not downloaded yet
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_b1e0e775df7bad2e5b86963108c497f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b1e0e775df7bad2e5b86963108c497f5.jpg not downloaded yet
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_efcb0cd052b9eb30a0721213ed20cf4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_efcb0cd052b9eb30a0721213ed20cf4e.jpg not downloaded yet
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_e99a5fed78dc409b3c28f1908a26d481.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_e99a5fed78dc409b3c28f1908a26d481.jpg not downloaded yet
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_25898a7eec4e190244d7f3412b85afab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_25898a7eec4e190244d7f3412b85afab.jpg not downloaded yet
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ad36d0>
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_399d0a47edd7857b47aa7ea1213d628c.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_399d0a47edd7857b47aa7ea1213d628c.jpg saved to cache
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c23f7f8-f497-5a56-afa7-f360b4435e94
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_f46eda1e76dab09ad3ddbcae631d2304.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_f46eda1e76dab09ad3ddbcae631d2304.jpg not downloaded yet
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_a64737b4ac1a86bd5e21a07efeea0989.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_a64737b4ac1a86bd5e21a07efeea0989.jpg not downloaded yet
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_b5060b07e6e9f9f69dd573718ecabcb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b5060b07e6e9f9f69dd573718ecabcb7.jpg not downloaded yet
2026-03-30 12:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_ac9798e5e296ea68e15569e2fa1f4331.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_39bf93b94a58445ecca72e1399433bf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_39bf93b94a58445ecca72e1399433bf3.jpg not downloaded yet
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_fa508c5b32ef5e795ebed4aebd2d3f52.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_fa508c5b32ef5e795ebed4aebd2d3f52.jpg not downloaded yet
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6970d50>
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_ac9798e5e296ea68e15569e2fa1f4331.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_ac9798e5e296ea68e15569e2fa1f4331.jpg saved to cache
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c23f7f8-f497-5a56-afa7-f360b4435e94
2026-03-30 12:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b5060b07e6e9f9f69dd573718ecabcb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_fa508c5b32ef5e795ebed4aebd2d3f52.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_39bf93b94a58445ecca72e1399433bf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60df5d0>
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_b5060b07e6e9f9f69dd573718ecabcb7.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b5060b07e6e9f9f69dd573718ecabcb7.jpg saved to cache
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f10810>
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_fa508c5b32ef5e795ebed4aebd2d3f52.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_fa508c5b32ef5e795ebed4aebd2d3f52.jpg saved to cache
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6052010>
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_39bf93b94a58445ecca72e1399433bf3.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_39bf93b94a58445ecca72e1399433bf3.jpg saved to cache
2026-03-30 12:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_a64737b4ac1a86bd5e21a07efeea0989.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_f46eda1e76dab09ad3ddbcae631d2304.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_25898a7eec4e190244d7f3412b85afab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbece90>
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_a64737b4ac1a86bd5e21a07efeea0989.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_a64737b4ac1a86bd5e21a07efeea0989.jpg saved to cache
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6970710>
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_f46eda1e76dab09ad3ddbcae631d2304.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_f46eda1e76dab09ad3ddbcae631d2304.jpg saved to cache
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60dfa90>
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_25898a7eec4e190244d7f3412b85afab.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_25898a7eec4e190244d7f3412b85afab.jpg saved to cache
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_e99a5fed78dc409b3c28f1908a26d481.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_efcb0cd052b9eb30a0721213ed20cf4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b1e0e775df7bad2e5b86963108c497f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f2f490>
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_e99a5fed78dc409b3c28f1908a26d481.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_e99a5fed78dc409b3c28f1908a26d481.jpg saved to cache
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f38090>
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_efcb0cd052b9eb30a0721213ed20cf4e.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_efcb0cd052b9eb30a0721213ed20cf4e.jpg saved to cache
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6059050>
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_b1e0e775df7bad2e5b86963108c497f5.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b1e0e775df7bad2e5b86963108c497f5.jpg saved to cache
2026-03-30 12:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_94fbcb37f862d44415d0eee0258c37a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_f6566c0410fcc4221e4d0b59a274d112.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_093b9d6930465510f1e9b222336cfe54.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6dad0>
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F51%252F4f517c9b866d79c24bc4040a8259fb79%252Fpa%252FGH07415_94fbcb37f862d44415d0eee0258c37a3.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_94fbcb37f862d44415d0eee0258c37a3.jpg saved to cache
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db
2026-03-30 12:25:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0a411e7-4336-58cb-9d03-bad0ce4aa4db, skipping ID generation
2026-03-30 12:25:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db with scrape type 1
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0a411e7-4336-58cb-9d03-bad0ce4aa4db sending to next pipeline
2026-03-30 12:25:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b0a411e7-4336-58cb-9d03-bad0ce4aa4db, identifier: GH07415
2026-03-30 12:25:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b0a411e7-4336-58cb-9d03-bad0ce4aa4db with identifier: GH07415
2026-03-30 12:25:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b0a411e7-4336-58cb-9d03-bad0ce4aa4db with identifier: GH07415
2026-03-30 12:25:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b0a411e7-4336-58cb-9d03-bad0ce4aa4db with identifier: GH07415 to the API
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_94fbcb37f862d44415d0eee0258c37a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:39:59Z',
 'fuel_type': 'diesel',
 'id': 'b0a411e7-4336-58cb-9d03-bad0ce4aa4db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'VV584G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH07415',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 125304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_94fbcb37f862d44415d0eee0258c37a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653194,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b1e0e775df7bad2e5b86963108c497f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_efcb0cd052b9eb30a0721213ed20cf4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3004364,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_e99a5fed78dc409b3c28f1908a26d481.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_25898a7eec4e190244d7f3412b85afab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2664581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_f46eda1e76dab09ad3ddbcae631d2304.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_a64737b4ac1a86bd5e21a07efeea0989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_b5060b07e6e9f9f69dd573718ecabcb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619319,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_39bf93b94a58445ecca72e1399433bf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a411e7-4336-58cb-9d03-bad0ce4aa4db/b0a411e7-4336-58cb-9d03-bad0ce4aa4db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/51/4f517c9b866d79c24bc4040a8259fb79/pa/GH07415_fa508c5b32ef5e795ebed4aebd2d3f52.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2016}
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH07415%27 HTTP/1.1" 200 None
2026-03-30 12:25:28 [auto1.nl] INFO: Saving data for GH07415: {'created_time': 1774873528.687751, 'last_price_update_time': 1774873528.687762, 'auction_closing_time': 1774971599.0}
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GH07415') HTTP/1.1" 204 0
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ab7810>
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_f6566c0410fcc4221e4d0b59a274d112.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_f6566c0410fcc4221e4d0b59a274d112.jpg saved to cache
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c23f7f8-f497-5a56-afa7-f360b4435e94
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f7e7d0>
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a8d16bf9e3288cab3ef9dc4fe4fad%252Fpa%252FFF84926_093b9d6930465510f1e9b222336cfe54.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_093b9d6930465510f1e9b222336cfe54.jpg saved to cache
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c23f7f8-f497-5a56-afa7-f360b4435e94
2026-03-30 12:25:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c23f7f8-f497-5a56-afa7-f360b4435e94, skipping ID generation
2026-03-30 12:25:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c23f7f8-f497-5a56-afa7-f360b4435e94 with scrape type 1
2026-03-30 12:25:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c23f7f8-f497-5a56-afa7-f360b4435e94 sending to next pipeline
2026-03-30 12:25:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0c23f7f8-f497-5a56-afa7-f360b4435e94, identifier: FF84926
2026-03-30 12:25:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0c23f7f8-f497-5a56-afa7-f360b4435e94 with identifier: FF84926
2026-03-30 12:25:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0c23f7f8-f497-5a56-afa7-f360b4435e94 with identifier: FF84926
2026-03-30 12:25:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0c23f7f8-f497-5a56-afa7-f360b4435e94 with identifier: FF84926 to the API
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_093b9d6930465510f1e9b222336cfe54.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 1',
 'engine': '3.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:09:11Z',
 'fuel_type': 'petrol',
 'id': '0c23f7f8-f497-5a56-afa7-f360b4435e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GN-TV-58',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF84926',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Chrysler',
 'model': 'Le Baron',
 'odometer': 93473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_093b9d6930465510f1e9b222336cfe54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_f6566c0410fcc4221e4d0b59a274d112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_ac9798e5e296ea68e15569e2fa1f4331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_399d0a47edd7857b47aa7ea1213d628c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_9e335d071f6e8d85c028f1c192cb5eb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c23f7f8-f497-5a56-afa7-f360b4435e94/0c23f7f8-f497-5a56-afa7-f360b4435e94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a8d16bf9e3288cab3ef9dc4fe4fad/pa/FF84926_3eac0deca622fca4d9fa2a6ef1756f06.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1993-05-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Chrysler Le Baron 3.0 LX Cabrio',
 'transmission': 'automatic',
 'trim': 'LX Cabrio',
 'year': 1993}
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF84926%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Saving data for FF84926: {'created_time': 1774873529.472015, 'last_price_update_time': 1774873529.472025, 'auction_closing_time': 1774969751.0}
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FF84926') HTTP/1.1" 204 0
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE20082> (referer: https://www.auto1.com/v1/car-details-view/XE20082/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec with identifier: XE20082
2026-03-30 12:25:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec with scrape type 1
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_ff0c7a9ca97c43b01d9ed5054dd08583.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_ff0c7a9ca97c43b01d9ed5054dd08583.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_3a513991404fac41a857aed6b74eabc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3a513991404fac41a857aed6b74eabc5.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_a89eb2cddbc6bdbcbec3c29864c03c13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a89eb2cddbc6bdbcbec3c29864c03c13.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_001d2e6346a708e65906e88e9deaed57.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_001d2e6346a708e65906e88e9deaed57.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_3546ea1f38506db4a749af94a403a07e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3546ea1f38506db4a749af94a403a07e.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_a845a549fddda292b7aa9a275485fcd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a845a549fddda292b7aa9a275485fcd5.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_b84af6cc38935e0205ec62938799af3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_b84af6cc38935e0205ec62938799af3f.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_1c7df20773b26dc293cd826f8d4dcf89.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_1c7df20773b26dc293cd826f8d4dcf89.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_f861ab984c1cfd3a7d998fcf556d6d5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_f861ab984c1cfd3a7d998fcf556d6d5b.jpg not downloaded yet
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_8b39ff76a954182a465590d084c92127.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_8b39ff76a954182a465590d084c92127.jpg not downloaded yet
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_ff0c7a9ca97c43b01d9ed5054dd08583.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60fb890>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_ff0c7a9ca97c43b01d9ed5054dd08583.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_ff0c7a9ca97c43b01d9ed5054dd08583.jpg saved to cache
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_8b39ff76a954182a465590d084c92127.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_f861ab984c1cfd3a7d998fcf556d6d5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbf1090>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_8b39ff76a954182a465590d084c92127.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_8b39ff76a954182a465590d084c92127.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f10150>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_f861ab984c1cfd3a7d998fcf556d6d5b.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_f861ab984c1cfd3a7d998fcf556d6d5b.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_1c7df20773b26dc293cd826f8d4dcf89.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_b84af6cc38935e0205ec62938799af3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6e510>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_1c7df20773b26dc293cd826f8d4dcf89.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_1c7df20773b26dc293cd826f8d4dcf89.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6f210>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_b84af6cc38935e0205ec62938799af3f.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_b84af6cc38935e0205ec62938799af3f.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a845a549fddda292b7aa9a275485fcd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3546ea1f38506db4a749af94a403a07e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a76b50>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_a845a549fddda292b7aa9a275485fcd5.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a845a549fddda292b7aa9a275485fcd5.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a766d0>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_3546ea1f38506db4a749af94a403a07e.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3546ea1f38506db4a749af94a403a07e.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_001d2e6346a708e65906e88e9deaed57.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a89eb2cddbc6bdbcbec3c29864c03c13.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6d250>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_001d2e6346a708e65906e88e9deaed57.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_001d2e6346a708e65906e88e9deaed57.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60cd8d0>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_a89eb2cddbc6bdbcbec3c29864c03c13.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a89eb2cddbc6bdbcbec3c29864c03c13.jpg saved to cache
2026-03-30 12:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3a513991404fac41a857aed6b74eabc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.745(s), this was the 1st time calling it.
2026-03-30 12:25:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.137564323039715 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d601a2d0>
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F44%252F3a4429ec335b8b649119f131eff7a5b0%252Fpa%252FXE20082_3a513991404fac41a857aed6b74eabc5.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3a513991404fac41a857aed6b74eabc5.jpg saved to cache
2026-03-30 12:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec
2026-03-30 12:25:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec, skipping ID generation
2026-03-30 12:25:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec with scrape type 1
2026-03-30 12:25:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec sending to next pipeline
2026-03-30 12:25:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec, identifier: XE20082
2026-03-30 12:25:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec with identifier: XE20082
2026-03-30 12:25:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec with identifier: XE20082
2026-03-30 12:25:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 810d5788-cf81-58f7-8f7c-6a7ed2ab02ec with identifier: XE20082 to the API
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3a513991404fac41a857aed6b74eabc5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:21:21Z',
 'fuel_type': 'petrol',
 'id': '810d5788-cf81-58f7-8f7c-6a7ed2ab02ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE20082',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 81726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4055586,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_ff0c7a9ca97c43b01d9ed5054dd08583.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3a513991404fac41a857aed6b74eabc5.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a89eb2cddbc6bdbcbec3c29864c03c13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_001d2e6346a708e65906e88e9deaed57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_3546ea1f38506db4a749af94a403a07e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_a845a549fddda292b7aa9a275485fcd5.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_b84af6cc38935e0205ec62938799af3f.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_1c7df20773b26dc293cd826f8d4dcf89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_f861ab984c1cfd3a7d998fcf556d6d5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810d5788-cf81-58f7-8f7c-6a7ed2ab02ec/810d5788-cf81-58f7-8f7c-6a7ed2ab02ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/44/3a4429ec335b8b649119f131eff7a5b0/pa/XE20082_8b39ff76a954182a465590d084c92127.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Business Elegance Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Elegance Start/Stop',
 'year': 2020}
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XE20082%27 HTTP/1.1" 200 None
2026-03-30 12:25:32 [auto1.nl] INFO: Saving data for XE20082: {'created_time': 1774873532.516749, 'last_price_update_time': 1774873532.51676, 'auction_closing_time': 1774970481.0}
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XE20082') HTTP/1.1" 204 0
2026-03-30 12:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT02482> (referer: https://www.auto1.com/v1/car-details-view/UT02482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7fafeb-e4b6-5518-9a7b-9550117e97e4 with identifier: UT02482
2026-03-30 12:25:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4 with scrape type 1
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_12134560a433935ad0203ba7d5eccfef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_12134560a433935ad0203ba7d5eccfef.jpg not downloaded yet
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_f515ddfa724d8b2c4444a99a4bd92673.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f515ddfa724d8b2c4444a99a4bd92673.jpg not downloaded yet
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_7e093f7a9f88f62dc878be3b99cde631.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_7e093f7a9f88f62dc878be3b99cde631.jpg not downloaded yet
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_f94703e7136d7e47a8fd3d5780c6f2a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f94703e7136d7e47a8fd3d5780c6f2a3.jpg not downloaded yet
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_e60524670ab8774dee3eb666f09f0728.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_e60524670ab8774dee3eb666f09f0728.jpg not downloaded yet
2026-03-30 12:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_12134560a433935ad0203ba7d5eccfef.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f515ddfa724d8b2c4444a99a4bd92673.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_e60524670ab8774dee3eb666f09f0728.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f94703e7136d7e47a8fd3d5780c6f2a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_7e093f7a9f88f62dc878be3b99cde631.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ae1dd0>
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_12134560a433935ad0203ba7d5eccfef.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_12134560a433935ad0203ba7d5eccfef.jpg saved to cache
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f7db10>
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_f515ddfa724d8b2c4444a99a4bd92673.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f515ddfa724d8b2c4444a99a4bd92673.jpg saved to cache
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c09d0>
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_e60524670ab8774dee3eb666f09f0728.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_e60524670ab8774dee3eb666f09f0728.jpg saved to cache
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f577d0>
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_f94703e7136d7e47a8fd3d5780c6f2a3.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f94703e7136d7e47a8fd3d5780c6f2a3.jpg saved to cache
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6981d90>
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F5b%252F275b51faf9728b31693d764d3cc9623a%252Fpa%252FUT02482_7e093f7a9f88f62dc878be3b99cde631.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_7e093f7a9f88f62dc878be3b99cde631.jpg saved to cache
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4
2026-03-30 12:25:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f7fafeb-e4b6-5518-9a7b-9550117e97e4, skipping ID generation
2026-03-30 12:25:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4 with scrape type 1
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f7fafeb-e4b6-5518-9a7b-9550117e97e4 sending to next pipeline
2026-03-30 12:25:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1f7fafeb-e4b6-5518-9a7b-9550117e97e4, identifier: UT02482
2026-03-30 12:25:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1f7fafeb-e4b6-5518-9a7b-9550117e97e4 with identifier: UT02482
2026-03-30 12:25:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1f7fafeb-e4b6-5518-9a7b-9550117e97e4 with identifier: UT02482
2026-03-30 12:25:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1f7fafeb-e4b6-5518-9a7b-9550117e97e4 with identifier: UT02482 to the API
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_7e093f7a9f88f62dc878be3b99cde631.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:44:59Z',
 'fuel_type': 'petrol',
 'id': '1f7fafeb-e4b6-5518-9a7b-9550117e97e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HDB07J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT02482',
 'listing': 'auction',
 'location': 'NL, Breda',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 126814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_12134560a433935ad0203ba7d5eccfef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f515ddfa724d8b2c4444a99a4bd92673.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_7e093f7a9f88f62dc878be3b99cde631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_f94703e7136d7e47a8fd3d5780c6f2a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7fafeb-e4b6-5518-9a7b-9550117e97e4/1f7fafeb-e4b6-5518-9a7b-9550117e97e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/5b/275b51faf9728b31693d764d3cc9623a/pa/UT02482_e60524670ab8774dee3eb666f09f0728.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 ECO2',
 'transmission': 'manual',
 'trim': 'ECO2',
 'year': 2010}
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT02482%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [auto1.nl] INFO: Saving data for UT02482: {'created_time': 1774873535.463696, 'last_price_update_time': 1774873535.463706, 'auction_closing_time': 1774971899.0}
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UT02482') HTTP/1.1" 204 0
2026-03-30 12:25:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE92727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD51522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC70915/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.724(s), this was the 1st time calling it.
2026-03-30 12:25:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.8169294219992014 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX45692> (referer: https://www.auto1.com/v1/car-details-view/VX45692/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32485c4a-7fc2-5ea8-a59f-61a99aa20af8 with identifier: VX45692
2026-03-30 12:25:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8 with scrape type 1
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_3b7d8c0208a5c6091788e4a78af0b8e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_3b7d8c0208a5c6091788e4a78af0b8e9.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_c3018d9447b731a09cc2a18073be59ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_c3018d9447b731a09cc2a18073be59ac.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_ce2b7ed44c6b98ed8091d35569236d4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_ce2b7ed44c6b98ed8091d35569236d4c.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_4a4c3170c0de883a61cac0f1f4705b97.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_4a4c3170c0de883a61cac0f1f4705b97.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_169c89c3ac57fcba4f7af152e7689e0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_169c89c3ac57fcba4f7af152e7689e0e.jpg not downloaded yet
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_3b7d8c0208a5c6091788e4a78af0b8e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_c3018d9447b731a09cc2a18073be59ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_169c89c3ac57fcba4f7af152e7689e0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_4a4c3170c0de883a61cac0f1f4705b97.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f61350>
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_3b7d8c0208a5c6091788e4a78af0b8e9.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_3b7d8c0208a5c6091788e4a78af0b8e9.jpg saved to cache
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6927910>
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_c3018d9447b731a09cc2a18073be59ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_c3018d9447b731a09cc2a18073be59ac.jpg saved to cache
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8
2026-03-30 12:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_ce2b7ed44c6b98ed8091d35569236d4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60dc8d0>
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_169c89c3ac57fcba4f7af152e7689e0e.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_169c89c3ac57fcba4f7af152e7689e0e.jpg saved to cache
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f825d0>
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_4a4c3170c0de883a61cac0f1f4705b97.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_4a4c3170c0de883a61cac0f1f4705b97.jpg saved to cache
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f38590>
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F54%252Fc454941914957ae110e98fea87f7af1b%252Fpa%252FVX45692_ce2b7ed44c6b98ed8091d35569236d4c.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_ce2b7ed44c6b98ed8091d35569236d4c.jpg saved to cache
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8
2026-03-30 12:25:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32485c4a-7fc2-5ea8-a59f-61a99aa20af8, skipping ID generation
2026-03-30 12:25:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8 with scrape type 1
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32485c4a-7fc2-5ea8-a59f-61a99aa20af8 sending to next pipeline
2026-03-30 12:25:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32485c4a-7fc2-5ea8-a59f-61a99aa20af8, identifier: VX45692
2026-03-30 12:25:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32485c4a-7fc2-5ea8-a59f-61a99aa20af8 with identifier: VX45692
2026-03-30 12:25:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32485c4a-7fc2-5ea8-a59f-61a99aa20af8 with identifier: VX45692
2026-03-30 12:25:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32485c4a-7fc2-5ea8-a59f-61a99aa20af8 with identifier: VX45692 to the API
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_ce2b7ed44c6b98ed8091d35569236d4c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:45:41Z',
 'fuel_type': 'petrol',
 'id': '32485c4a-7fc2-5ea8-a59f-61a99aa20af8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '25JLZ4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX45692',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 286140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_3b7d8c0208a5c6091788e4a78af0b8e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_c3018d9447b731a09cc2a18073be59ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_ce2b7ed44c6b98ed8091d35569236d4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_4a4c3170c0de883a61cac0f1f4705b97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32485c4a-7fc2-5ea8-a59f-61a99aa20af8/32485c4a-7fc2-5ea8-a59f-61a99aa20af8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/54/c454941914957ae110e98fea87f7af1b/pa/VX45692_169c89c3ac57fcba4f7af152e7689e0e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX45692%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.nl] INFO: Saving data for VX45692: {'created_time': 1774873545.569149, 'last_price_update_time': 1774873545.569168, 'auction_closing_time': 1774971941.0}
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VX45692') HTTP/1.1" 204 0
2026-03-30 12:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:45 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 1032 | hits on page: 40
2026-03-30 12:25:45 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-30 12:25:45 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-30 12:25:45 [auto1.nl] INFO: Found listing with ID: SV58198
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV58198%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.nl] INFO: Scrape type for SV58198: 2
2026-03-30 12:25:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b038db9b-75cd-5cb5-baae-20e83b4aeb72 with identifier: SV58198
2026-03-30 12:25:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b038db9b-75cd-5cb5-baae-20e83b4aeb72 with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b038db9b-75cd-5cb5-baae-20e83b4aeb72 with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b038db9b-75cd-5cb5-baae-20e83b4aeb72, identifier: SV58198
2026-03-30 12:25:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b038db9b-75cd-5cb5-baae-20e83b4aeb72 with identifier: SV58198
2026-03-30 12:25:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b038db9b-75cd-5cb5-baae-20e83b4aeb72 with identifier: SV58198
2026-03-30 12:25:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b038db9b-75cd-5cb5-baae-20e83b4aeb72 with identifier: SV58198 to the API
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:56:39Z',
 'fuel_type': 'petrol',
 'id': 'b038db9b-75cd-5cb5-baae-20e83b4aeb72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV58198',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 136370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-09',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV58198%27 HTTP/1.1" 200 None
2026-03-30 12:25:46 [auto1.nl] INFO: Saving data for SV58198: {'auction_closing_time': 1774972599.0, 'created_time': 1774552342.746214, 'last_price_update_time': 1774873546.139877}
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV58198') HTTP/1.1" 204 0
2026-03-30 12:25:46 [auto1.nl] INFO: Found listing with ID: RA55443
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA55443%27 HTTP/1.1" 200 None
2026-03-30 12:25:46 [auto1.nl] INFO: Scrape type for RA55443: 2
2026-03-30 12:25:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c with identifier: RA55443
2026-03-30 12:25:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c with scrape type 2
2026-03-30 12:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c with scrape type 2
2026-03-30 12:25:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c, identifier: RA55443
2026-03-30 12:25:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c with identifier: RA55443
2026-03-30 12:25:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c with identifier: RA55443
2026-03-30 12:25:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c with identifier: RA55443 to the API
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:12:58Z',
 'fuel_type': 'diesel',
 'id': '2a0bb6d9-9a0c-5434-bf22-7b0f776ccc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA55443',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 443715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-15',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA55443%27 HTTP/1.1" 200 None
2026-03-30 12:25:46 [auto1.nl] INFO: Saving data for RA55443: {'auction_closing_time': 1774969978.0, 'created_time': 1773385825.318712, 'last_price_update_time': 1774873546.666042}
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RA55443') HTTP/1.1" 204 0
2026-03-30 12:25:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:25:46 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-30 12:25:46 [auto1.nl] INFO: Scrape type for FJ04475: 2
2026-03-30 12:25:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-30 12:25:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b249a31f-66af-5e6c-9918-fdb2ad096d7e with scrape type 2
2026-03-30 12:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b249a31f-66af-5e6c-9918-fdb2ad096d7e with scrape type 2
2026-03-30 12:25:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b249a31f-66af-5e6c-9918-fdb2ad096d7e, identifier: FJ04475
2026-03-30 12:25:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-30 12:25:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-30 12:25:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475 to the API
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:22:07Z',
 'fuel_type': 'petrol',
 'id': 'b249a31f-66af-5e6c-9918-fdb2ad096d7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ04475',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 264799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2012}
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.nl] INFO: Saving data for FJ04475: {'auction_closing_time': 1774970527.0, 'created_time': 1773664237.04298, 'last_price_update_time': 1774873547.20846}
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ04475') HTTP/1.1" 204 0
2026-03-30 12:25:47 [auto1.nl] INFO: Found listing with ID: AK57667
2026-03-30 12:25:47 [auto1.nl] INFO: Found listing with ID: DD20442
2026-03-30 12:25:47 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-30 12:25:47 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-30 12:25:47 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG56616%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.nl] INFO: Scrape type for HG56616: 2
2026-03-30 12:25:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616
2026-03-30 12:25:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9968adb5-3aec-55b4-b841-d22ba1171ecf with scrape type 2
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9968adb5-3aec-55b4-b841-d22ba1171ecf with scrape type 2
2026-03-30 12:25:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9968adb5-3aec-55b4-b841-d22ba1171ecf, identifier: HG56616
2026-03-30 12:25:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616
2026-03-30 12:25:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616
2026-03-30 12:25:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9968adb5-3aec-55b4-b841-d22ba1171ecf with identifier: HG56616 to the API
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-31T15:13:04Z',
 'fuel_type': 'petrol',
 'id': '9968adb5-3aec-55b4-b841-d22ba1171ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG56616',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 280618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-07',
 'seller_name': None,
 'title': 'Volvo V70 2.0 T Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2010}
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG56616%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.nl] INFO: Saving data for HG56616: {'auction_closing_time': 1774969984.0, 'created_time': 1773515455.99366, 'last_price_update_time': 1774873547.736045}
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HG56616') HTTP/1.1" 204 0
2026-03-30 12:25:47 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-30 12:25:47 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.nl] INFO: Scrape type for PD16289: 2
2026-03-30 12:25:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289
2026-03-30 12:25:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with scrape type 2
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with scrape type 2
2026-03-30 12:25:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5dbca311-f3b9-593c-8b35-49acac5cd0b5, identifier: PD16289
2026-03-30 12:25:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289
2026-03-30 12:25:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289
2026-03-30 12:25:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5dbca311-f3b9-593c-8b35-49acac5cd0b5 with identifier: PD16289 to the API
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:06:14Z',
 'fuel_type': 'petrol',
 'id': '5dbca311-f3b9-593c-8b35-49acac5cd0b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD16289',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 219899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-05',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 Avantage 2009',
 'transmission': 'manual',
 'trim': 'Avantage 2009',
 'year': 2009}
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-30 12:25:48 [auto1.nl] INFO: Saving data for PD16289: {'auction_closing_time': 1774969574.0, 'created_time': 1774440631.388149, 'last_price_update_time': 1774873548.334832}
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PD16289') HTTP/1.1" 204 0
2026-03-30 12:25:48 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-30 12:25:48 [auto1.nl] INFO: Found listing with ID: GM35453
2026-03-30 12:25:48 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-30 12:25:48 [auto1.nl] INFO: Scrape type for GH52378: 2
2026-03-30 12:25:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378
2026-03-30 12:25:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea2cd50d-a700-5882-9762-459aaa090a0b with scrape type 2
2026-03-30 12:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea2cd50d-a700-5882-9762-459aaa090a0b with scrape type 2
2026-03-30 12:25:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea2cd50d-a700-5882-9762-459aaa090a0b, identifier: GH52378
2026-03-30 12:25:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378
2026-03-30 12:25:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378
2026-03-30 12:25:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378 to the API
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:51Z',
 'fuel_type': 'petrol',
 'id': 'ea2cd50d-a700-5882-9762-459aaa090a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH52378',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 99883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-26',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-30 12:25:48 [auto1.nl] INFO: Saving data for GH52378: {'auction_closing_time': 1774970331.0, 'created_time': 1774465973.088998, 'last_price_update_time': 1774873548.77633}
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GH52378') HTTP/1.1" 204 0
2026-03-30 12:25:48 [auto1.nl] INFO: Found listing with ID: BC58597
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC58597%27 HTTP/1.1" 200 None
2026-03-30 12:25:48 [auto1.nl] INFO: Scrape type for BC58597: 1
2026-03-30 12:25:48 [auto1.nl] INFO: Found listing with ID: ML05704
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML05704%27 HTTP/1.1" 200 None
2026-03-30 12:25:48 [auto1.nl] INFO: Scrape type for ML05704: 2
2026-03-30 12:25:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f with identifier: ML05704
2026-03-30 12:25:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f with scrape type 2
2026-03-30 12:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f with scrape type 2
2026-03-30 12:25:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f, identifier: ML05704
2026-03-30 12:25:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f with identifier: ML05704
2026-03-30 12:25:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f with identifier: ML05704
2026-03-30 12:25:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f with identifier: ML05704 to the API
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:43:06Z',
 'fuel_type': 'diesel',
 'id': '0b7ee455-5cf3-548a-a56e-8c36b4bb5a8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML05704',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 190851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d xLine',
 'transmission': 'manual',
 'trim': 'xLine',
 'year': 2016}
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML05704%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.nl] INFO: Saving data for ML05704: {'auction_closing_time': 1774971786.0, 'created_time': 1774293111.780644, 'last_price_update_time': 1774873549.292573}
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML05704') HTTP/1.1" 204 0
2026-03-30 12:25:49 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-30 12:25:49 [auto1.nl] INFO: Found listing with ID: DW60052
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW60052%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.nl] INFO: Scrape type for DW60052: 2
2026-03-30 12:25:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5b4bf94-4b3b-5edb-bad4-0c43229f908d with identifier: DW60052
2026-03-30 12:25:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b4bf94-4b3b-5edb-bad4-0c43229f908d with scrape type 2
2026-03-30 12:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5b4bf94-4b3b-5edb-bad4-0c43229f908d with scrape type 2
2026-03-30 12:25:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5b4bf94-4b3b-5edb-bad4-0c43229f908d, identifier: DW60052
2026-03-30 12:25:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5b4bf94-4b3b-5edb-bad4-0c43229f908d with identifier: DW60052
2026-03-30 12:25:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5b4bf94-4b3b-5edb-bad4-0c43229f908d with identifier: DW60052
2026-03-30 12:25:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5b4bf94-4b3b-5edb-bad4-0c43229f908d with identifier: DW60052 to the API
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:39:06Z',
 'fuel_type': 'petrol',
 'id': 'f5b4bf94-4b3b-5edb-bad4-0c43229f908d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW60052',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 151414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency AMG Sport',
 'transmission': 'manual',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW60052%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.nl] INFO: Saving data for DW60052: {'auction_closing_time': 1774971546.0, 'created_time': 1773232090.132442, 'last_price_update_time': 1774873549.998881}
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW60052') HTTP/1.1" 204 0
2026-03-30 12:25:50 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-30 12:25:50 [auto1.nl] INFO: Scrape type for SX35832: 2
2026-03-30 12:25:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-30 12:25:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5327012-ac9e-578d-8d90-156cca28f9cd with scrape type 2
2026-03-30 12:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5327012-ac9e-578d-8d90-156cca28f9cd with scrape type 2
2026-03-30 12:25:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5327012-ac9e-578d-8d90-156cca28f9cd, identifier: SX35832
2026-03-30 12:25:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-30 12:25:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-30 12:25:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832 to the API
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:57:14Z',
 'fuel_type': 'petrol',
 'id': 'f5327012-ac9e-578d-8d90-156cca28f9cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX35832',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 179932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-30 12:25:50 [auto1.nl] INFO: Saving data for SX35832: {'auction_closing_time': 1774972634.0, 'created_time': 1773229554.129226, 'last_price_update_time': 1774873550.475122}
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX35832') HTTP/1.1" 204 0
2026-03-30 12:25:50 [auto1.nl] INFO: Found listing with ID: HZ42118
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ42118%27 HTTP/1.1" 200 None
2026-03-30 12:25:50 [auto1.nl] INFO: Scrape type for HZ42118: 2
2026-03-30 12:25:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 532a8d13-8f06-55d9-910a-75c9a40d0b2e with identifier: HZ42118
2026-03-30 12:25:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532a8d13-8f06-55d9-910a-75c9a40d0b2e with scrape type 2
2026-03-30 12:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 532a8d13-8f06-55d9-910a-75c9a40d0b2e with scrape type 2
2026-03-30 12:25:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 532a8d13-8f06-55d9-910a-75c9a40d0b2e, identifier: HZ42118
2026-03-30 12:25:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 532a8d13-8f06-55d9-910a-75c9a40d0b2e with identifier: HZ42118
2026-03-30 12:25:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 532a8d13-8f06-55d9-910a-75c9a40d0b2e with identifier: HZ42118
2026-03-30 12:25:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 532a8d13-8f06-55d9-910a-75c9a40d0b2e with identifier: HZ42118 to the API
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:24:52Z',
 'fuel_type': 'petrol',
 'id': '532a8d13-8f06-55d9-910a-75c9a40d0b2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ42118',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 265239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ42118%27 HTTP/1.1" 200 None
2026-03-30 12:25:51 [auto1.nl] INFO: Saving data for HZ42118: {'auction_closing_time': 1774970692.0, 'created_time': 1774267887.004594, 'last_price_update_time': 1774873551.000486}
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ42118') HTTP/1.1" 204 0
2026-03-30 12:25:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.606(s), this was the 1st time calling it.
2026-03-30 12:25:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.789801651359664 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:51 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-30 12:25:51 [auto1.nl] INFO: Found listing with ID: VF41372
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF41372%27 HTTP/1.1" 200 None
2026-03-30 12:25:51 [auto1.nl] INFO: Scrape type for VF41372: 2
2026-03-30 12:25:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 897926a8-47ee-51d1-aac5-24113b9d8425 with identifier: VF41372
2026-03-30 12:25:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 897926a8-47ee-51d1-aac5-24113b9d8425 with scrape type 2
2026-03-30 12:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 897926a8-47ee-51d1-aac5-24113b9d8425 with scrape type 2
2026-03-30 12:25:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 897926a8-47ee-51d1-aac5-24113b9d8425, identifier: VF41372
2026-03-30 12:25:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 897926a8-47ee-51d1-aac5-24113b9d8425 with identifier: VF41372
2026-03-30 12:25:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 897926a8-47ee-51d1-aac5-24113b9d8425 with identifier: VF41372
2026-03-30 12:25:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 897926a8-47ee-51d1-aac5-24113b9d8425 with identifier: VF41372 to the API
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:04:05Z',
 'fuel_type': 'petrol',
 'id': '897926a8-47ee-51d1-aac5-24113b9d8425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF41372',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 241978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-24',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Bose Edition',
 'transmission': 'automatic',
 'trim': 'Bose Edition',
 'year': 2017}
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF41372%27 HTTP/1.1" 200 None
2026-03-30 12:25:51 [auto1.nl] INFO: Saving data for VF41372: {'auction_closing_time': 1774969445.0, 'created_time': 1773232220.033191, 'last_price_update_time': 1774873551.540742}
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF41372') HTTP/1.1" 204 0
2026-03-30 12:25:51 [auto1.nl] INFO: Found listing with ID: JY08621
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY08621%27 HTTP/1.1" 200 None
2026-03-30 12:25:51 [auto1.nl] INFO: Scrape type for JY08621: 2
2026-03-30 12:25:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbcd0962-de2b-5669-b85d-68723cd2ca85 with identifier: JY08621
2026-03-30 12:25:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbcd0962-de2b-5669-b85d-68723cd2ca85 with scrape type 2
2026-03-30 12:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbcd0962-de2b-5669-b85d-68723cd2ca85 with scrape type 2
2026-03-30 12:25:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bbcd0962-de2b-5669-b85d-68723cd2ca85, identifier: JY08621
2026-03-30 12:25:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bbcd0962-de2b-5669-b85d-68723cd2ca85 with identifier: JY08621
2026-03-30 12:25:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bbcd0962-de2b-5669-b85d-68723cd2ca85 with identifier: JY08621
2026-03-30 12:25:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bbcd0962-de2b-5669-b85d-68723cd2ca85 with identifier: JY08621 to the API
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:49:07Z',
 'fuel_type': 'petrol',
 'id': 'bbcd0962-de2b-5669-b85d-68723cd2ca85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY08621',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 279454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-01',
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.6 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY08621%27 HTTP/1.1" 200 None
2026-03-30 12:25:51 [auto1.nl] INFO: Saving data for JY08621: {'auction_closing_time': 1774972147.0, 'created_time': 1774379550.878168, 'last_price_update_time': 1774873551.999079}
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JY08621') HTTP/1.1" 204 0
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: KB54920
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: CR62554
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: LE06862
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: LJ21279
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ21279%27 HTTP/1.1" 200 None
2026-03-30 12:25:52 [auto1.nl] INFO: Scrape type for LJ21279: 2
2026-03-30 12:25:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 943a1571-e950-57ad-be4b-60025f5942f4 with identifier: LJ21279
2026-03-30 12:25:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943a1571-e950-57ad-be4b-60025f5942f4 with scrape type 2
2026-03-30 12:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 943a1571-e950-57ad-be4b-60025f5942f4 with scrape type 2
2026-03-30 12:25:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 943a1571-e950-57ad-be4b-60025f5942f4, identifier: LJ21279
2026-03-30 12:25:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 943a1571-e950-57ad-be4b-60025f5942f4 with identifier: LJ21279
2026-03-30 12:25:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 943a1571-e950-57ad-be4b-60025f5942f4 with identifier: LJ21279
2026-03-30 12:25:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 943a1571-e950-57ad-be4b-60025f5942f4 with identifier: LJ21279 to the API
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-31T15:52:05Z',
 'fuel_type': 'hybrid',
 'id': '943a1571-e950-57ad-be4b-60025f5942f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ21279',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 141142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Top 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Top 4WD',
 'year': 2015}
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ21279%27 HTTP/1.1" 200 None
2026-03-30 12:25:52 [auto1.nl] INFO: Saving data for LJ21279: {'auction_closing_time': 1774972325.0, 'created_time': 1773688697.841316, 'last_price_update_time': 1774873552.472617}
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LJ21279') HTTP/1.1" 204 0
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: SL25522
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL25522%27 HTTP/1.1" 200 None
2026-03-30 12:25:52 [auto1.nl] INFO: Scrape type for SL25522: 1
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: GX31648
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: DA24355
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA24355%27 HTTP/1.1" 200 None
2026-03-30 12:25:52 [auto1.nl] INFO: Scrape type for DA24355: 2
2026-03-30 12:25:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26a4ecd-8810-58b9-a4cb-bd0d767f0f0f with identifier: DA24355
2026-03-30 12:25:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26a4ecd-8810-58b9-a4cb-bd0d767f0f0f with scrape type 2
2026-03-30 12:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d26a4ecd-8810-58b9-a4cb-bd0d767f0f0f with scrape type 2
2026-03-30 12:25:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d26a4ecd-8810-58b9-a4cb-bd0d767f0f0f, identifier: DA24355
2026-03-30 12:25:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d26a4ecd-8810-58b9-a4cb-bd0d767f0f0f with identifier: DA24355
2026-03-30 12:25:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d26a4ecd-8810-58b9-a4cb-bd0d767f0f0f with identifier: DA24355
2026-03-30 12:25:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d26a4ecd-8810-58b9-a4cb-bd0d767f0f0f with identifier: DA24355 to the API
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:04:25Z',
 'fuel_type': 'diesel',
 'id': 'd26a4ecd-8810-58b9-a4cb-bd0d767f0f0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA24355',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 296622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA24355%27 HTTP/1.1" 200 None
2026-03-30 12:25:52 [auto1.nl] INFO: Saving data for DA24355: {'auction_closing_time': 1774969465.0, 'created_time': 1773133955.28249, 'last_price_update_time': 1774873552.948438}
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA24355') HTTP/1.1" 204 0
2026-03-30 12:25:52 [auto1.nl] INFO: Found listing with ID: FZ81296
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ81296%27 HTTP/1.1" 200 None
2026-03-30 12:25:52 [auto1.nl] INFO: Scrape type for FZ81296: 2
2026-03-30 12:25:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89d8d6e1-c362-55fe-bdd9-2a43648411a8 with identifier: FZ81296
2026-03-30 12:25:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89d8d6e1-c362-55fe-bdd9-2a43648411a8 with scrape type 2
2026-03-30 12:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89d8d6e1-c362-55fe-bdd9-2a43648411a8 with scrape type 2
2026-03-30 12:25:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 89d8d6e1-c362-55fe-bdd9-2a43648411a8, identifier: FZ81296
2026-03-30 12:25:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 89d8d6e1-c362-55fe-bdd9-2a43648411a8 with identifier: FZ81296
2026-03-30 12:25:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 89d8d6e1-c362-55fe-bdd9-2a43648411a8 with identifier: FZ81296
2026-03-30 12:25:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 89d8d6e1-c362-55fe-bdd9-2a43648411a8 with identifier: FZ81296 to the API
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:49:35Z',
 'fuel_type': 'petrol',
 'id': '89d8d6e1-c362-55fe-bdd9-2a43648411a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ81296',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 241391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ81296%27 HTTP/1.1" 200 None
2026-03-30 12:25:53 [auto1.nl] INFO: Saving data for FZ81296: {'auction_closing_time': 1774972175.0, 'created_time': 1774293049.855176, 'last_price_update_time': 1774873553.443049}
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FZ81296') HTTP/1.1" 204 0
2026-03-30 12:25:53 [auto1.nl] INFO: Found listing with ID: CV38071
2026-03-30 12:25:53 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-30 12:25:53 [auto1.nl] INFO: Scrape type for BL56682: 2
2026-03-30 12:25:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682
2026-03-30 12:25:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f49fbdf-4416-55d7-963d-d66f72278814 with scrape type 2
2026-03-30 12:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f49fbdf-4416-55d7-963d-d66f72278814 with scrape type 2
2026-03-30 12:25:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f49fbdf-4416-55d7-963d-d66f72278814, identifier: BL56682
2026-03-30 12:25:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682
2026-03-30 12:25:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682
2026-03-30 12:25:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f49fbdf-4416-55d7-963d-d66f72278814 with identifier: BL56682 to the API
2026-03-30 12:25:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:30:16Z',
 'fuel_type': 'petrol',
 'id': '3f49fbdf-4416-55d7-963d-d66f72278814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL56682',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 228764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-25',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [auto1.nl] INFO: Saving data for BL56682: {'auction_closing_time': 1774971016.0, 'created_time': 1774440666.01257, 'last_price_update_time': 1774873554.297658}
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BL56682') HTTP/1.1" 204 0
2026-03-30 12:25:54 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [auto1.nl] INFO: Scrape type for MW65068: 2
2026-03-30 12:25:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068
2026-03-30 12:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with scrape type 2
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with scrape type 2
2026-03-30 12:25:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3, identifier: MW65068
2026-03-30 12:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX43694> (referer: https://www.auto1.com/v1/car-details-view/NX43694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068
2026-03-30 12:25:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068
2026-03-30 12:25:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96e0ab21-113e-59ef-99aa-7afbfd4ea1a3 with identifier: MW65068 to the API
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:18:07Z',
 'fuel_type': 'diesel',
 'id': '96e0ab21-113e-59ef-99aa-7afbfd4ea1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW65068',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 147823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1 Komfort Avantage',
 'transmission': 'manual',
 'trim': 'L1 Komfort Avantage',
 'year': 2014}
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [auto1.nl] INFO: Saving data for MW65068: {'auction_closing_time': 1774970287.0, 'created_time': 1774033828.20545, 'last_price_update_time': 1774873554.803463}
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW65068') HTTP/1.1" 204 0
2026-03-30 12:25:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:54 [auto1.nl] INFO: Found listing with ID: JZ36461
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ36461%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [auto1.nl] INFO: Scrape type for JZ36461: 2
2026-03-30 12:25:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ac0793c-fd15-5357-b013-394ac2727814 with identifier: JZ36461
2026-03-30 12:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ac0793c-fd15-5357-b013-394ac2727814 with scrape type 2
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ac0793c-fd15-5357-b013-394ac2727814 with scrape type 2
2026-03-30 12:25:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5ac0793c-fd15-5357-b013-394ac2727814, identifier: JZ36461
2026-03-30 12:25:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5ac0793c-fd15-5357-b013-394ac2727814 with identifier: JZ36461
2026-03-30 12:25:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5ac0793c-fd15-5357-b013-394ac2727814 with identifier: JZ36461
2026-03-30 12:25:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5ac0793c-fd15-5357-b013-394ac2727814 with identifier: JZ36461 to the API
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:43:48Z',
 'fuel_type': 'petrol',
 'id': '5ac0793c-fd15-5357-b013-394ac2727814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ36461',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 216972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-19',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ36461%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [auto1.nl] INFO: Saving data for JZ36461: {'auction_closing_time': 1774971828.0, 'created_time': 1774267905.832928, 'last_price_update_time': 1774873555.294238}
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JZ36461') HTTP/1.1" 204 0
2026-03-30 12:25:55 [auto1.nl] INFO: Found listing with ID: NT74232
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT74232%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [auto1.nl] INFO: Scrape type for NT74232: 2
2026-03-30 12:25:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 418cbfe5-16a2-5ec1-9da4-bb85802e723b with identifier: NT74232
2026-03-30 12:25:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 418cbfe5-16a2-5ec1-9da4-bb85802e723b with scrape type 2
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 418cbfe5-16a2-5ec1-9da4-bb85802e723b with scrape type 2
2026-03-30 12:25:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 418cbfe5-16a2-5ec1-9da4-bb85802e723b, identifier: NT74232
2026-03-30 12:25:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 418cbfe5-16a2-5ec1-9da4-bb85802e723b with identifier: NT74232
2026-03-30 12:25:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 418cbfe5-16a2-5ec1-9da4-bb85802e723b with identifier: NT74232
2026-03-30 12:25:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 418cbfe5-16a2-5ec1-9da4-bb85802e723b with identifier: NT74232 to the API
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:41:22Z',
 'fuel_type': 'petrol',
 'id': '418cbfe5-16a2-5ec1-9da4-bb85802e723b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT74232',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 215411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-01',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.2 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2010}
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT74232%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [auto1.nl] INFO: Saving data for NT74232: {'auction_closing_time': 1774971682.0, 'created_time': 1774354409.525501, 'last_price_update_time': 1774873555.749434}
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT74232') HTTP/1.1" 204 0
2026-03-30 12:25:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5fc373-e1f3-59e1-81ce-b27fb2caef8a with identifier: NX43694
2026-03-30 12:25:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5fc373-e1f3-59e1-81ce-b27fb2caef8a with scrape type 1
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d5fc373-e1f3-59e1-81ce-b27fb2caef8a
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_4bc60e5a1c7e299ca6c21e120d778c2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_4bc60e5a1c7e299ca6c21e120d778c2b.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_52a6f6d3210c773508530ef0f5363e0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_52a6f6d3210c773508530ef0f5363e0c.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_30916adb877f93927c801dac72ca4348.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_30916adb877f93927c801dac72ca4348.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_2e1763747aaf4c072668d9bd429be64d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_2e1763747aaf4c072668d9bd429be64d.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_ce2ff1381f3f5653f315a9777d5364b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_ce2ff1381f3f5653f315a9777d5364b6.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_e16b31c2533e1f089dea53c57fd111c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_e16b31c2533e1f089dea53c57fd111c3.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_0fef5c564fdec245108a2a268cdc9e88.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_0fef5c564fdec245108a2a268cdc9e88.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_80ca7635b30e0b1f5f8ee78e3399f850.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_80ca7635b30e0b1f5f8ee78e3399f850.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_c0a7f73f457406802cf2e29db29d4cf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_c0a7f73f457406802cf2e29db29d4cf4.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F62%252F16622e6642f06054274986a935a50018%252Fpa%252FNX43694_cd4dafbd8d0c4efce5c9eec60063512d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_cd4dafbd8d0c4efce5c9eec60063512d.jpg already downloaded
2026-03-30 12:25:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8d5fc373-e1f3-59e1-81ce-b27fb2caef8a, identifier: NX43694
2026-03-30 12:25:56 [auto1.nl] INFO: Found listing with ID: UZ08221
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UZ08221%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.nl] INFO: Scrape type for UZ08221: 1
2026-03-30 12:25:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8d5fc373-e1f3-59e1-81ce-b27fb2caef8a with identifier: NX43694
2026-03-30 12:25:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8d5fc373-e1f3-59e1-81ce-b27fb2caef8a with identifier: NX43694
2026-03-30 12:25:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8d5fc373-e1f3-59e1-81ce-b27fb2caef8a with identifier: NX43694 to the API
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX43694>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:39:42Z',
 'fuel_type': 'petrol',
 'id': '8d5fc373-e1f3-59e1-81ce-b27fb2caef8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '5SVR41',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX43694',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'BMW',
 'model': '3er',
 'odometer': 135380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_4bc60e5a1c7e299ca6c21e120d778c2b.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_52a6f6d3210c773508530ef0f5363e0c.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_30916adb877f93927c801dac72ca4348.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_2e1763747aaf4c072668d9bd429be64d.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_ce2ff1381f3f5653f315a9777d5364b6.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_e16b31c2533e1f089dea53c57fd111c3.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_0fef5c564fdec245108a2a268cdc9e88.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_80ca7635b30e0b1f5f8ee78e3399f850.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_c0a7f73f457406802cf2e29db29d4cf4.jpg',
                'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_cd4dafbd8d0c4efce5c9eec60063512d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_4bc60e5a1c7e299ca6c21e120d778c2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_52a6f6d3210c773508530ef0f5363e0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754837,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_30916adb877f93927c801dac72ca4348.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2755544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_2e1763747aaf4c072668d9bd429be64d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_ce2ff1381f3f5653f315a9777d5364b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_e16b31c2533e1f089dea53c57fd111c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2658498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_0fef5c564fdec245108a2a268cdc9e88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_80ca7635b30e0b1f5f8ee78e3399f850.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_c0a7f73f457406802cf2e29db29d4cf4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d5fc373-e1f3-59e1-81ce-b27fb2caef8a/8d5fc373-e1f3-59e1-81ce-b27fb2caef8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017012,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/62/16622e6642f06054274986a935a50018/pa/NX43694_cd4dafbd8d0c4efce5c9eec60063512d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX43694%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.nl] INFO: Saving data for NX43694: {'created_time': 1774873556.454429, 'last_price_update_time': 1774873556.454446, 'auction_closing_time': 1774971582.0}
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX43694') HTTP/1.1" 204 0
2026-03-30 12:25:56 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.nl] INFO: Scrape type for VT81070: 2
2026-03-30 12:25:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070
2026-03-30 12:25:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b6fa53-1974-57fe-8126-e82a2a9066e8 with scrape type 2
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1b6fa53-1974-57fe-8126-e82a2a9066e8 with scrape type 2
2026-03-30 12:25:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1b6fa53-1974-57fe-8126-e82a2a9066e8, identifier: VT81070
2026-03-30 12:25:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070
2026-03-30 12:25:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070
2026-03-30 12:25:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070 to the API
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:20:12Z',
 'fuel_type': 'petrol',
 'id': 'c1b6fa53-1974-57fe-8126-e82a2a9066e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT81070',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 188733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Attract 2WD',
 'transmission': 'manual',
 'trim': 'Attract 2WD',
 'year': 2016}
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.nl] INFO: Saving data for VT81070: {'auction_closing_time': 1774970412.0, 'created_time': 1774527057.252096, 'last_price_update_time': 1774873556.953764}
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VT81070') HTTP/1.1" 204 0
2026-03-30 12:25:56 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.nl] INFO: Scrape type for RD50492: 2
2026-03-30 12:25:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492
2026-03-30 12:25:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e156fc90-d653-51d4-b766-d854cca6a626 with scrape type 2
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e156fc90-d653-51d4-b766-d854cca6a626 with scrape type 2
2026-03-30 12:25:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e156fc90-d653-51d4-b766-d854cca6a626, identifier: RD50492
2026-03-30 12:25:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492
2026-03-30 12:25:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492
2026-03-30 12:25:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492 to the API
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:12:50Z',
 'fuel_type': 'diesel',
 'id': 'e156fc90-d653-51d4-b766-d854cca6a626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD50492',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 416525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-19',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 260 K LKW',
 'transmission': 'manual',
 'trim': 'FT 260 K LKW',
 'year': 2007}
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.nl] INFO: Saving data for RD50492: {'auction_closing_time': 1774969970.0, 'created_time': 1774527060.674706, 'last_price_update_time': 1774873557.389809}
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD50492') HTTP/1.1" 204 0
2026-03-30 12:25:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU09064> (referer: https://www.auto1.com/v1/car-details-view/UU09064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cda48232-3e7b-5ae1-9857-cd1a9dd875a2 with identifier: UU09064
2026-03-30 12:25:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2 with scrape type 1
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_c14cb92bc3a821598d20bc64d72106d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_c14cb92bc3a821598d20bc64d72106d0.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_3e157c5dc464cbd4382933360b042a9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_3e157c5dc464cbd4382933360b042a9f.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_9f06a3141fc708eaad0267fd928a5c3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9f06a3141fc708eaad0267fd928a5c3f.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_707590ab4d3bd01c9b5ad5ecc47e2a0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_707590ab4d3bd01c9b5ad5ecc47e2a0a.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_7702f7b9efde9d4388d379f07d3c0093.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_7702f7b9efde9d4388d379f07d3c0093.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_9afc2b8a9dc776b9b2905ecd68c5474d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9afc2b8a9dc776b9b2905ecd68c5474d.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_9080677a65ca980046afcc87126d3ae8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9080677a65ca980046afcc87126d3ae8.jpg not downloaded yet
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_c14cb92bc3a821598d20bc64d72106d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_ee5f5f1d4830ad45b82762c75afe1298.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_ee5f5f1d4830ad45b82762c75afe1298.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_5eeef02843f3e50bb1221de35dfa43e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_5eeef02843f3e50bb1221de35dfa43e7.jpg not downloaded yet
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_d510571c234b9da237b4f15ef39627d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_d510571c234b9da237b4f15ef39627d7.jpg not downloaded yet
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d69fbd10>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_c14cb92bc3a821598d20bc64d72106d0.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_c14cb92bc3a821598d20bc64d72106d0.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9080677a65ca980046afcc87126d3ae8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_3e157c5dc464cbd4382933360b042a9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_5eeef02843f3e50bb1221de35dfa43e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a76990>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_9080677a65ca980046afcc87126d3ae8.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9080677a65ca980046afcc87126d3ae8.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_d510571c234b9da237b4f15ef39627d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a4f3d0>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_3e157c5dc464cbd4382933360b042a9f.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_3e157c5dc464cbd4382933360b042a9f.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c6290>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_5eeef02843f3e50bb1221de35dfa43e7.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_5eeef02843f3e50bb1221de35dfa43e7.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6967610>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_d510571c234b9da237b4f15ef39627d7.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_d510571c234b9da237b4f15ef39627d7.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9afc2b8a9dc776b9b2905ecd68c5474d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_ee5f5f1d4830ad45b82762c75afe1298.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_707590ab4d3bd01c9b5ad5ecc47e2a0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a7a810>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_9afc2b8a9dc776b9b2905ecd68c5474d.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9afc2b8a9dc776b9b2905ecd68c5474d.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_7702f7b9efde9d4388d379f07d3c0093.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f3bb90>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_ee5f5f1d4830ad45b82762c75afe1298.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_ee5f5f1d4830ad45b82762c75afe1298.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:25:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6028b50>
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_707590ab4d3bd01c9b5ad5ecc47e2a0a.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_707590ab4d3bd01c9b5ad5ecc47e2a0a.jpg saved to cache
2026-03-30 12:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:26:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB41881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbe96d0>
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_7702f7b9efde9d4388d379f07d3c0093.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_7702f7b9efde9d4388d379f07d3c0093.jpg saved to cache
2026-03-30 12:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:26:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9f06a3141fc708eaad0267fd928a5c3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f1fd50>
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F8e%252Fe08e235c357d144c96ae66a6dd60e4a4%252Fpa%252FUU09064_9f06a3141fc708eaad0267fd928a5c3f.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9f06a3141fc708eaad0267fd928a5c3f.jpg saved to cache
2026-03-30 12:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2
2026-03-30 12:26:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cda48232-3e7b-5ae1-9857-cd1a9dd875a2, skipping ID generation
2026-03-30 12:26:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2 with scrape type 1
2026-03-30 12:26:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cda48232-3e7b-5ae1-9857-cd1a9dd875a2 sending to next pipeline
2026-03-30 12:26:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cda48232-3e7b-5ae1-9857-cd1a9dd875a2, identifier: UU09064
2026-03-30 12:26:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cda48232-3e7b-5ae1-9857-cd1a9dd875a2 with identifier: UU09064
2026-03-30 12:26:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cda48232-3e7b-5ae1-9857-cd1a9dd875a2 with identifier: UU09064
2026-03-30 12:26:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cda48232-3e7b-5ae1-9857-cd1a9dd875a2 with identifier: UU09064 to the API
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9f06a3141fc708eaad0267fd928a5c3f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:21:38Z',
 'fuel_type': 'petrol',
 'id': 'cda48232-3e7b-5ae1-9857-cd1a9dd875a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '5SLL76',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU09064',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 40770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_c14cb92bc3a821598d20bc64d72106d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2141967,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_3e157c5dc464cbd4382933360b042a9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2237084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9f06a3141fc708eaad0267fd928a5c3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_707590ab4d3bd01c9b5ad5ecc47e2a0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_7702f7b9efde9d4388d379f07d3c0093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2216488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9afc2b8a9dc776b9b2905ecd68c5474d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372202,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_9080677a65ca980046afcc87126d3ae8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2299777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_ee5f5f1d4830ad45b82762c75afe1298.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2198728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_5eeef02843f3e50bb1221de35dfa43e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cda48232-3e7b-5ae1-9857-cd1a9dd875a2/cda48232-3e7b-5ae1-9857-cd1a9dd875a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/8e/e08e235c357d144c96ae66a6dd60e4a4/pa/UU09064_d510571c234b9da237b4f15ef39627d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2013}
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU09064%27 HTTP/1.1" 200 None
2026-03-30 12:26:00 [auto1.nl] INFO: Saving data for UU09064: {'created_time': 1774873560.941758, 'last_price_update_time': 1774873560.941768, 'auction_closing_time': 1774970498.0}
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UU09064') HTTP/1.1" 204 0
2026-03-30 12:26:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.806(s), this was the 1st time calling it.
2026-03-30 12:26:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.68949542200847 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:26:07 [scrapy.extensions.logstats] INFO: Crawled 113 pages (at 12 pages/min), scraped 98 items (at 28 items/min)
2026-03-30 12:26:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD51522> (referer: https://www.auto1.com/v1/car-details-view/SD51522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1d672f-bca6-5df5-af15-c2384536f1d2 with identifier: SD51522
2026-03-30 12:26:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1d672f-bca6-5df5-af15-c2384536f1d2 with scrape type 1
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dc1d672f-bca6-5df5-af15-c2384536f1d2
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_c8889db42054ba05e00d2c45c4748257.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_c8889db42054ba05e00d2c45c4748257.jpg not downloaded yet
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_54ebe1b4feadae3456f4483334947599.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_54ebe1b4feadae3456f4483334947599.jpg not downloaded yet
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_76e83dabac60fe935884d6774fc2d25f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_76e83dabac60fe935884d6774fc2d25f.jpg not downloaded yet
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_4a00cee67054a0791655249a9d875a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4a00cee67054a0791655249a9d875a8d.jpg not downloaded yet
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_4c1644a8606889a7b8f7094c0470609f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4c1644a8606889a7b8f7094c0470609f.jpg not downloaded yet
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_16ccbcd728c412f7aa093ee13b8d2089.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_16ccbcd728c412f7aa093ee13b8d2089.jpg not downloaded yet
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_c8889db42054ba05e00d2c45c4748257.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_76e83dabac60fe935884d6774fc2d25f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4c1644a8606889a7b8f7094c0470609f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_16ccbcd728c412f7aa093ee13b8d2089.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4a00cee67054a0791655249a9d875a8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f7d390>
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_c8889db42054ba05e00d2c45c4748257.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_c8889db42054ba05e00d2c45c4748257.jpg saved to cache
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc1d672f-bca6-5df5-af15-c2384536f1d2
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_54ebe1b4feadae3456f4483334947599.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c6b50>
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_76e83dabac60fe935884d6774fc2d25f.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_76e83dabac60fe935884d6774fc2d25f.jpg saved to cache
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc1d672f-bca6-5df5-af15-c2384536f1d2
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f7c650>
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_4c1644a8606889a7b8f7094c0470609f.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4c1644a8606889a7b8f7094c0470609f.jpg saved to cache
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc1d672f-bca6-5df5-af15-c2384536f1d2
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f49350>
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_16ccbcd728c412f7aa093ee13b8d2089.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_16ccbcd728c412f7aa093ee13b8d2089.jpg saved to cache
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc1d672f-bca6-5df5-af15-c2384536f1d2
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a86ed0>
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_4a00cee67054a0791655249a9d875a8d.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4a00cee67054a0791655249a9d875a8d.jpg saved to cache
2026-03-30 12:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc1d672f-bca6-5df5-af15-c2384536f1d2
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6937ed0>
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F13%252F18136037d51e0866666dc8d1ee55cfae%252Fpa%252FSD51522_54ebe1b4feadae3456f4483334947599.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_54ebe1b4feadae3456f4483334947599.jpg saved to cache
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc1d672f-bca6-5df5-af15-c2384536f1d2
2026-03-30 12:26:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc1d672f-bca6-5df5-af15-c2384536f1d2, skipping ID generation
2026-03-30 12:26:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1d672f-bca6-5df5-af15-c2384536f1d2 with scrape type 1
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc1d672f-bca6-5df5-af15-c2384536f1d2 sending to next pipeline
2026-03-30 12:26:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dc1d672f-bca6-5df5-af15-c2384536f1d2, identifier: SD51522
2026-03-30 12:26:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dc1d672f-bca6-5df5-af15-c2384536f1d2 with identifier: SD51522
2026-03-30 12:26:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dc1d672f-bca6-5df5-af15-c2384536f1d2 with identifier: SD51522
2026-03-30 12:26:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dc1d672f-bca6-5df5-af15-c2384536f1d2 with identifier: SD51522 to the API
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_54ebe1b4feadae3456f4483334947599.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 107,
 'expiration_date': '2026-03-31T15:11:13Z',
 'fuel_type': 'petrol',
 'id': 'dc1d672f-bca6-5df5-af15-c2384536f1d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '76-KHZ-2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD51522',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 244700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_c8889db42054ba05e00d2c45c4748257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_54ebe1b4feadae3456f4483334947599.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_76e83dabac60fe935884d6774fc2d25f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4a00cee67054a0791655249a9d875a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_4c1644a8606889a7b8f7094c0470609f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1d672f-bca6-5df5-af15-c2384536f1d2/dc1d672f-bca6-5df5-af15-c2384536f1d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/13/18136037d51e0866666dc8d1ee55cfae/pa/SD51522_16ccbcd728c412f7aa093ee13b8d2089.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Streetline Club',
 'transmission': 'manual',
 'trim': 'Streetline Club',
 'year': 2009}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD51522%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.nl] INFO: Saving data for SD51522: {'created_time': 1774873570.090294, 'last_price_update_time': 1774873570.090305, 'auction_closing_time': 1774969873.0}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD51522') HTTP/1.1" 204 0
2026-03-30 12:26:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:26:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.269(s), this was the 1st time calling it.
2026-03-30 12:26:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.307310487130131 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:26:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US84379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:35 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 1033 | hits on page: 40
2026-03-30 12:26:35 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Scrape type for RD50492: 0
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: BP54166
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP54166%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Scrape type for BP54166: 1
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: EJ03630
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: TG38127
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG38127%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Scrape type for TG38127: 1
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: WH88048
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Scrape type for BP47777: 2
2026-03-30 12:26:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777
2026-03-30 12:26:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ae7386-4228-5a9d-81b0-128222f07e91 with scrape type 2
2026-03-30 12:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2ae7386-4228-5a9d-81b0-128222f07e91 with scrape type 2
2026-03-30 12:26:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2ae7386-4228-5a9d-81b0-128222f07e91, identifier: BP47777
2026-03-30 12:26:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777
2026-03-30 12:26:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777
2026-03-30 12:26:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777 to the API
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:39:15Z',
 'fuel_type': 'petrol',
 'id': 'b2ae7386-4228-5a9d-81b0-128222f07e91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP47777',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 101194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-17',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Saving data for BP47777: {'auction_closing_time': 1774971555.0, 'created_time': 1774527052.161339, 'last_price_update_time': 1774873596.801844}
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP47777') HTTP/1.1" 204 0
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Scrape type for AM68781: 0
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: SV30103
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: KC17574
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC17574%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Scrape type for KC17574: 0
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: UR49266
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR49266%27 HTTP/1.1" 200 None
2026-03-30 12:26:36 [auto1.nl] INFO: Scrape type for UR49266: 0
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: ZG07781
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: NC71096
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: FV06268
2026-03-30 12:26:36 [auto1.nl] INFO: Found listing with ID: UD25640
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD25640%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for UD25640: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: YL18933
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: TN50119
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: YV69069
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: MU90689
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for GY66252: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: MR60949
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: VF08835
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF08835%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for VF08835: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: FM69133
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY95005%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for NY95005: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: MX79285
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: WA03298
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for MU55364: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: LA89986
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: FA90105
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA90105%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for FA90105: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE73966%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for SE73966: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22652%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for SV22652: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: EL19724
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL19724%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for EL19724: 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for BY07410: 2
2026-03-30 12:26:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-30 12:26:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224f6637-7c71-548e-8dbe-10d58d9ac847 with scrape type 2
2026-03-30 12:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224f6637-7c71-548e-8dbe-10d58d9ac847 with scrape type 2
2026-03-30 12:26:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 224f6637-7c71-548e-8dbe-10d58d9ac847, identifier: BY07410
2026-03-30 12:26:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-30 12:26:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-30 12:26:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410 to the API
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:00:38Z',
 'fuel_type': 'petrol',
 'id': '224f6637-7c71-548e-8dbe-10d58d9ac847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY07410',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3 Cabrio',
 'odometer': 132796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Citroen DS3 Cabrio 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2013}
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Saving data for BY07410: {'auction_closing_time': 1774882838.0, 'created_time': 1773927659.32465, 'last_price_update_time': 1774873597.597415}
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY07410') HTTP/1.1" 204 0
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 12:26:37 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-30 12:26:37 [auto1.nl] INFO: Scrape type for KZ40216: 2
2026-03-30 12:26:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-30 12:26:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with scrape type 2
2026-03-30 12:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with scrape type 2
2026-03-30 12:26:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f, identifier: KZ40216
2026-03-30 12:26:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-30 12:26:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-30 12:26:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216 to the API
2026-03-30 12:26:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:46:49Z',
 'fuel_type': 'petrol',
 'id': '03e329dd-f4f2-54a2-af8a-dd2eded85e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ40216',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 195392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-22',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2013}
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [auto1.nl] INFO: Saving data for KZ40216: {'auction_closing_time': 1774885609.0, 'created_time': 1773861356.385734, 'last_price_update_time': 1774873598.135815}
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ40216') HTTP/1.1" 204 0
2026-03-30 12:26:38 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [auto1.nl] INFO: Scrape type for VD19679: 2
2026-03-30 12:26:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-30 12:26:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f8d6cd-6bff-55b1-83b0-736023b02205 with scrape type 2
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f8d6cd-6bff-55b1-83b0-736023b02205 with scrape type 2
2026-03-30 12:26:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 97f8d6cd-6bff-55b1-83b0-736023b02205, identifier: VD19679
2026-03-30 12:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC70915> (referer: https://www.auto1.com/v1/car-details-view/YC70915/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-30 12:26:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-30 12:26:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679 to the API
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:33Z',
 'fuel_type': 'diesel',
 'id': '97f8d6cd-6bff-55b1-83b0-736023b02205',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD19679',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 233118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [auto1.nl] INFO: Saving data for VD19679: {'auction_closing_time': 1774885353.0, 'created_time': 1774268182.880489, 'last_price_update_time': 1774873598.546082}
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD19679') HTTP/1.1" 204 0
2026-03-30 12:26:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb with identifier: YC70915
2026-03-30 12:26:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb with scrape type 1
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_601aa6c1b1423334d670a416f6f59bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_601aa6c1b1423334d670a416f6f59bbb.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_827c593ec7888f768f35def952cd83c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_827c593ec7888f768f35def952cd83c9.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_996ef843d816c824ff3e33b3f7b33a70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_996ef843d816c824ff3e33b3f7b33a70.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_be6694e15eb399c4f825361d952f6e49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_be6694e15eb399c4f825361d952f6e49.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_2c59fae577da234d9de61c49c9bc18fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_2c59fae577da234d9de61c49c9bc18fc.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_74624efafe6f04e56ae7046a9a785262.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_74624efafe6f04e56ae7046a9a785262.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_8cf9343abf3553234793bdfb05e95bef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_8cf9343abf3553234793bdfb05e95bef.jpg not downloaded yet
2026-03-30 12:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_827c593ec7888f768f35def952cd83c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_ba94cb6e70d121b7340f89f14518f904.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_ba94cb6e70d121b7340f89f14518f904.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_98c60e1a56a6dae34dd4366fcaa71450.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_98c60e1a56a6dae34dd4366fcaa71450.jpg not downloaded yet
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_a0137fb19a516b060249715358ae7fc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_a0137fb19a516b060249715358ae7fc0.jpg not downloaded yet
2026-03-30 12:26:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f73fd0>
2026-03-30 12:26:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_827c593ec7888f768f35def952cd83c9.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_827c593ec7888f768f35def952cd83c9.jpg saved to cache
2026-03-30 12:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_601aa6c1b1423334d670a416f6f59bbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_8cf9343abf3553234793bdfb05e95bef.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:26:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:26:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:26:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:26:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f382d0>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_601aa6c1b1423334d670a416f6f59bbb.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_601aa6c1b1423334d670a416f6f59bbb.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f4aa50>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_8cf9343abf3553234793bdfb05e95bef.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_8cf9343abf3553234793bdfb05e95bef.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_98c60e1a56a6dae34dd4366fcaa71450.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_a0137fb19a516b060249715358ae7fc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_74624efafe6f04e56ae7046a9a785262.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_2c59fae577da234d9de61c49c9bc18fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d601a950>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_98c60e1a56a6dae34dd4366fcaa71450.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_98c60e1a56a6dae34dd4366fcaa71450.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbf1410>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_a0137fb19a516b060249715358ae7fc0.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_a0137fb19a516b060249715358ae7fc0.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_be6694e15eb399c4f825361d952f6e49.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6037350>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_74624efafe6f04e56ae7046a9a785262.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_74624efafe6f04e56ae7046a9a785262.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_ba94cb6e70d121b7340f89f14518f904.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f1e850>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_2c59fae577da234d9de61c49c9bc18fc.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_2c59fae577da234d9de61c49c9bc18fc.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_996ef843d816c824ff3e33b3f7b33a70.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL25522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d690f410>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_be6694e15eb399c4f825361d952f6e49.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_be6694e15eb399c4f825361d952f6e49.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f5c2d0>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_ba94cb6e70d121b7340f89f14518f904.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_ba94cb6e70d121b7340f89f14518f904.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d770ced0>
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fdb%252Ff0db5fb472e0813c5d1e89c3c8ff6a5c%252Fpa%252FYC70915_996ef843d816c824ff3e33b3f7b33a70.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_996ef843d816c824ff3e33b3f7b33a70.jpg saved to cache
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb
2026-03-30 12:26:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb, skipping ID generation
2026-03-30 12:26:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb with scrape type 1
2026-03-30 12:26:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb sending to next pipeline
2026-03-30 12:26:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb, identifier: YC70915
2026-03-30 12:26:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb with identifier: YC70915
2026-03-30 12:26:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb with identifier: YC70915
2026-03-30 12:26:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e650f35-ddd8-5a8b-b1d5-c859f45d41cb with identifier: YC70915 to the API
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_996ef843d816c824ff3e33b3f7b33a70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 266,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:17:44Z',
 'fuel_type': 'petrol',
 'id': '8e650f35-ddd8-5a8b-b1d5-c859f45d41cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC70915',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 333205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 9556082,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_601aa6c1b1423334d670a416f6f59bbb.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_827c593ec7888f768f35def952cd83c9.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_996ef843d816c824ff3e33b3f7b33a70.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_be6694e15eb399c4f825361d952f6e49.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_2c59fae577da234d9de61c49c9bc18fc.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_74624efafe6f04e56ae7046a9a785262.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_8cf9343abf3553234793bdfb05e95bef.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_ba94cb6e70d121b7340f89f14518f904.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_98c60e1a56a6dae34dd4366fcaa71450.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e650f35-ddd8-5a8b-b1d5-c859f45d41cb/8e650f35-ddd8-5a8b-b1d5-c859f45d41cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/db/f0db5fb472e0813c5d1e89c3c8ff6a5c/pa/YC70915_a0137fb19a516b060249715358ae7fc0.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC70 2.5 T AWD Kinetic',
 'transmission': 'automatic',
 'trim': 'AWD Kinetic',
 'year': 2005}
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC70915%27 HTTP/1.1" 200 None
2026-03-30 12:26:40 [auto1.nl] INFO: Saving data for YC70915: {'created_time': 1774873600.384581, 'last_price_update_time': 1774873600.384592, 'auction_closing_time': 1774970264.0}
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YC70915') HTTP/1.1" 204 0
2026-03-30 12:26:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ08221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC58597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.764(s), this was the 1st time calling it.
2026-03-30 12:26:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.796238194089084 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:26:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US84379> (referer: https://www.auto1.com/v1/car-details-view/US84379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76ce011c-24b2-56c5-99e8-399f97f3b931 with identifier: US84379
2026-03-30 12:26:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76ce011c-24b2-56c5-99e8-399f97f3b931 with scrape type 1
2026-03-30 12:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 76ce011c-24b2-56c5-99e8-399f97f3b931
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5e%252Fcd5eaae8f61f64cc8bd6701928148599%252Fpa%252FUS84379_f26e4d3f621c108e9729592ed9358972.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_f26e4d3f621c108e9729592ed9358972.jpg already downloaded
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5e%252Fcd5eaae8f61f64cc8bd6701928148599%252Fpa%252FUS84379_19c965e781d1c19f8141da6c0ae01484.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_19c965e781d1c19f8141da6c0ae01484.jpg already downloaded
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5e%252Fcd5eaae8f61f64cc8bd6701928148599%252Fpa%252FUS84379_59d9034fb5a37b509d47b31a1c415104.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_59d9034fb5a37b509d47b31a1c415104.jpg already downloaded
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5e%252Fcd5eaae8f61f64cc8bd6701928148599%252Fpa%252FUS84379_a69b8a6c9dd011b193ae716a01685709.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_a69b8a6c9dd011b193ae716a01685709.jpg already downloaded
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F5e%252Fcd5eaae8f61f64cc8bd6701928148599%252Fpa%252FUS84379_91108ab64c4f20b5ba8d3e481f5e3e7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_91108ab64c4f20b5ba8d3e481f5e3e7c.jpg already downloaded
2026-03-30 12:26:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 76ce011c-24b2-56c5-99e8-399f97f3b931, identifier: US84379
2026-03-30 12:26:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 76ce011c-24b2-56c5-99e8-399f97f3b931 with identifier: US84379
2026-03-30 12:26:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 76ce011c-24b2-56c5-99e8-399f97f3b931 with identifier: US84379
2026-03-30 12:26:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 76ce011c-24b2-56c5-99e8-399f97f3b931 with identifier: US84379 to the API
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/US84379>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:37:46Z',
 'fuel_type': 'petrol',
 'id': '76ce011c-24b2-56c5-99e8-399f97f3b931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '2xhd07',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US84379',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 232534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_f26e4d3f621c108e9729592ed9358972.jpg',
                'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_19c965e781d1c19f8141da6c0ae01484.jpg',
                'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_59d9034fb5a37b509d47b31a1c415104.jpg',
                'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_a69b8a6c9dd011b193ae716a01685709.jpg',
                'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_91108ab64c4f20b5ba8d3e481f5e3e7c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce011c-24b2-56c5-99e8-399f97f3b931/76ce011c-24b2-56c5-99e8-399f97f3b931_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_f26e4d3f621c108e9729592ed9358972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce011c-24b2-56c5-99e8-399f97f3b931/76ce011c-24b2-56c5-99e8-399f97f3b931_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_19c965e781d1c19f8141da6c0ae01484.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce011c-24b2-56c5-99e8-399f97f3b931/76ce011c-24b2-56c5-99e8-399f97f3b931_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_59d9034fb5a37b509d47b31a1c415104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce011c-24b2-56c5-99e8-399f97f3b931/76ce011c-24b2-56c5-99e8-399f97f3b931_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_a69b8a6c9dd011b193ae716a01685709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce011c-24b2-56c5-99e8-399f97f3b931/76ce011c-24b2-56c5-99e8-399f97f3b931_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/5e/cd5eaae8f61f64cc8bd6701928148599/pa/US84379_91108ab64c4f20b5ba8d3e481f5e3e7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 0.9 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2014}
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US84379%27 HTTP/1.1" 200 None
2026-03-30 12:26:44 [auto1.nl] INFO: Saving data for US84379: {'created_time': 1774873604.771876, 'last_price_update_time': 1774873604.771886, 'auction_closing_time': 1774971466.0}
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='US84379') HTTP/1.1" 204 0
2026-03-30 12:26:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB41881> (referer: https://www.auto1.com/v1/car-details-view/SB41881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b0e7b43-898e-581a-b771-81f90a2e460d with identifier: SB41881
2026-03-30 12:26:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b0e7b43-898e-581a-b771-81f90a2e460d with scrape type 1
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b0e7b43-898e-581a-b771-81f90a2e460d
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_14065d2fbf7568de7f10f6fb4d4724d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_14065d2fbf7568de7f10f6fb4d4724d4.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_89c2f19a6ece10f73ce1c11fec70bdee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_89c2f19a6ece10f73ce1c11fec70bdee.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_9418004a179c5a09d124fe375f8a8562.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_9418004a179c5a09d124fe375f8a8562.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_95652a0e93fe60481fb4480fa1c0d8e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_95652a0e93fe60481fb4480fa1c0d8e4.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_904ca1381ae5f18b98f808a2ad86c8b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_904ca1381ae5f18b98f808a2ad86c8b7.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_a03158ee035be2d27fd8da90d640ffd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_a03158ee035be2d27fd8da90d640ffd7.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_5de08cdfd214e54a256343978818852a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_5de08cdfd214e54a256343978818852a.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_e8aa07e9c36da1400ab7fbfe8e536ede.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_e8aa07e9c36da1400ab7fbfe8e536ede.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_1709e55fd147eab46ac42442aa08272c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_1709e55fd147eab46ac42442aa08272c.jpg already downloaded
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F4b%252F124bc8055e91a0b2855d0707b6b79e47%252Fpa%252FSB41881_b2611c4bc3cc2b4f7ccf4038bc86e5d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_b2611c4bc3cc2b4f7ccf4038bc86e5d7.jpg already downloaded
2026-03-30 12:26:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b0e7b43-898e-581a-b771-81f90a2e460d, identifier: SB41881
2026-03-30 12:26:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b0e7b43-898e-581a-b771-81f90a2e460d with identifier: SB41881
2026-03-30 12:26:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b0e7b43-898e-581a-b771-81f90a2e460d with identifier: SB41881
2026-03-30 12:26:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b0e7b43-898e-581a-b771-81f90a2e460d with identifier: SB41881 to the API
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB41881>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:49:21Z',
 'fuel_type': 'diesel',
 'id': '2b0e7b43-898e-581a-b771-81f90a2e460d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'V882RP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB41881',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 81113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_14065d2fbf7568de7f10f6fb4d4724d4.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_89c2f19a6ece10f73ce1c11fec70bdee.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_9418004a179c5a09d124fe375f8a8562.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_95652a0e93fe60481fb4480fa1c0d8e4.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_904ca1381ae5f18b98f808a2ad86c8b7.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_a03158ee035be2d27fd8da90d640ffd7.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_5de08cdfd214e54a256343978818852a.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_e8aa07e9c36da1400ab7fbfe8e536ede.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_1709e55fd147eab46ac42442aa08272c.jpg',
                'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_b2611c4bc3cc2b4f7ccf4038bc86e5d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_14065d2fbf7568de7f10f6fb4d4724d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_89c2f19a6ece10f73ce1c11fec70bdee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2886414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_9418004a179c5a09d124fe375f8a8562.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2698533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_95652a0e93fe60481fb4480fa1c0d8e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_904ca1381ae5f18b98f808a2ad86c8b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000232,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_a03158ee035be2d27fd8da90d640ffd7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_5de08cdfd214e54a256343978818852a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_e8aa07e9c36da1400ab7fbfe8e536ede.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_1709e55fd147eab46ac42442aa08272c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b0e7b43-898e-581a-b771-81f90a2e460d/2b0e7b43-898e-581a-b771-81f90a2e460d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/4b/124bc8055e91a0b2855d0707b6b79e47/pa/SB41881_b2611c4bc3cc2b4f7ccf4038bc86e5d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'automatic',
 'trim': '320 L1 Trend',
 'year': 2018}
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB41881%27 HTTP/1.1" 200 None
2026-03-30 12:26:56 [auto1.nl] INFO: Saving data for SB41881: {'created_time': 1774873616.431618, 'last_price_update_time': 1774873616.43163, 'auction_closing_time': 1774972161.0}
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SB41881') HTTP/1.1" 204 0
2026-03-30 12:27:07 [scrapy.extensions.logstats] INFO: Crawled 122 pages (at 9 pages/min), scraped 106 items (at 8 items/min)
2026-03-30 12:27:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:16 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 1036 | hits on page: 40
2026-03-30 12:27:16 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 12:27:16 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 12:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-30 12:27:16 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-30 12:27:16 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 12:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-30 12:27:16 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-30 12:27:16 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 12:27:16 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 12:27:16 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 12:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-30 12:27:16 [auto1.nl] INFO: Scrape type for XW90615: 2
2026-03-30 12:27:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-30 12:27:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99928119-baaf-5c23-95e8-0856a6b17c54 with scrape type 2
2026-03-30 12:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99928119-baaf-5c23-95e8-0856a6b17c54 with scrape type 2
2026-03-30 12:27:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99928119-baaf-5c23-95e8-0856a6b17c54, identifier: XW90615
2026-03-30 12:27:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-30 12:27:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-30 12:27:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615 to the API
2026-03-30 12:27:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:36Z',
 'fuel_type': 'petrol',
 'id': '99928119-baaf-5c23-95e8-0856a6b17c54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW90615',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 124186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-14',
 'seller_name': None,
 'title': "Kia cee'd 1.6 EX",
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2008}
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-30 12:27:17 [auto1.nl] INFO: Saving data for XW90615: {'auction_closing_time': 1774885476.0, 'created_time': 1774638724.979343, 'last_price_update_time': 1774873637.741605}
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW90615') HTTP/1.1" 204 0
2026-03-30 12:27:17 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 12:27:17 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-30 12:27:17 [auto1.nl] INFO: Scrape type for KJ03037: 2
2026-03-30 12:27:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037
2026-03-30 12:27:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with scrape type 2
2026-03-30 12:27:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with scrape type 2
2026-03-30 12:27:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4, identifier: KJ03037
2026-03-30 12:27:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037
2026-03-30 12:27:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037
2026-03-30 12:27:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037 to the API
2026-03-30 12:27:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:41:23Z',
 'fuel_type': 'petrol',
 'id': '8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ03037',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 132408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-09',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2006}
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [auto1.nl] INFO: Saving data for KJ03037: {'auction_closing_time': 1774885283.0, 'created_time': 1774552351.690151, 'last_price_update_time': 1774873638.150239}
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KJ03037') HTTP/1.1" 204 0
2026-03-30 12:27:18 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [auto1.nl] INFO: Scrape type for YC94295: 2
2026-03-30 12:27:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295
2026-03-30 12:27:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 082160fa-d71a-5841-a003-4e765e5910b1 with scrape type 2
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 082160fa-d71a-5841-a003-4e765e5910b1 with scrape type 2
2026-03-30 12:27:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 082160fa-d71a-5841-a003-4e765e5910b1, identifier: YC94295
2026-03-30 12:27:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295
2026-03-30 12:27:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295
2026-03-30 12:27:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295 to the API
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:23Z',
 'fuel_type': 'petrol',
 'id': '082160fa-d71a-5841-a003-4e765e5910b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC94295',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 227039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-04',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [auto1.nl] INFO: Saving data for YC94295: {'auction_closing_time': 1774884863.0, 'created_time': 1773229447.655904, 'last_price_update_time': 1774873638.775926}
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YC94295') HTTP/1.1" 204 0
2026-03-30 12:27:18 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [auto1.nl] INFO: Scrape type for PE07058: 2
2026-03-30 12:27:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058
2026-03-30 12:27:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38e57272-5be0-5234-93d3-af552ae4fa2b with scrape type 2
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38e57272-5be0-5234-93d3-af552ae4fa2b with scrape type 2
2026-03-30 12:27:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38e57272-5be0-5234-93d3-af552ae4fa2b, identifier: PE07058
2026-03-30 12:27:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058
2026-03-30 12:27:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058
2026-03-30 12:27:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058 to the API
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'petrol',
 'id': '38e57272-5be0-5234-93d3-af552ae4fa2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE07058',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 130685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [auto1.nl] INFO: Saving data for PE07058: {'auction_closing_time': 1774885961.0, 'created_time': 1774465829.812539, 'last_price_update_time': 1774873639.478517}
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PE07058') HTTP/1.1" 204 0
2026-03-30 12:27:19 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 12:27:19 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [auto1.nl] INFO: Scrape type for BW98362: 2
2026-03-30 12:27:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362
2026-03-30 12:27:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35a7dbd-c173-5002-92b1-b0660f881a04 with scrape type 2
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35a7dbd-c173-5002-92b1-b0660f881a04 with scrape type 2
2026-03-30 12:27:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b35a7dbd-c173-5002-92b1-b0660f881a04, identifier: BW98362
2026-03-30 12:27:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362
2026-03-30 12:27:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362
2026-03-30 12:27:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362 to the API
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:20:44Z',
 'fuel_type': 'petrol',
 'id': 'b35a7dbd-c173-5002-92b1-b0660f881a04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW98362',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 158700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [auto1.nl] INFO: Saving data for BW98362: {'auction_closing_time': 1774884044.0, 'created_time': 1774786234.004936, 'last_price_update_time': 1774873639.958675}
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BW98362') HTTP/1.1" 204 0
2026-03-30 12:27:19 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 12:27:19 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-30 12:27:19 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-30 12:27:19 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-30 12:27:19 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [auto1.nl] INFO: Scrape type for ZP63684: 2
2026-03-30 12:27:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684
2026-03-30 12:27:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776085b6-d397-5e9e-bd86-49f66258fcd5 with scrape type 2
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 776085b6-d397-5e9e-bd86-49f66258fcd5 with scrape type 2
2026-03-30 12:27:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 776085b6-d397-5e9e-bd86-49f66258fcd5, identifier: ZP63684
2026-03-30 12:27:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684
2026-03-30 12:27:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684
2026-03-30 12:27:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684 to the API
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'petrol',
 'id': '776085b6-d397-5e9e-bd86-49f66258fcd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP63684',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': '75',
 'odometer': 198968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-05',
 'seller_name': None,
 'title': 'MG Rover 75 1.8 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2005}
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [auto1.nl] INFO: Saving data for ZP63684: {'auction_closing_time': 1774886163.0, 'created_time': 1773232301.365285, 'last_price_update_time': 1774873640.556485}
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP63684') HTTP/1.1" 204 0
2026-03-30 12:27:20 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-30 12:27:20 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [auto1.nl] INFO: Scrape type for VL80205: 2
2026-03-30 12:27:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-30 12:27:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9520c497-6ea0-5467-8437-118e03e39bc8 with scrape type 2
2026-03-30 12:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9520c497-6ea0-5467-8437-118e03e39bc8 with scrape type 2
2026-03-30 12:27:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9520c497-6ea0-5467-8437-118e03e39bc8, identifier: VL80205
2026-03-30 12:27:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-30 12:27:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-30 12:27:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205 to the API
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:46Z',
 'fuel_type': 'petrol',
 'id': '9520c497-6ea0-5467-8437-118e03e39bc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL80205',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space',
 'odometer': 208362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-31',
 'seller_name': None,
 'title': 'Mitsubishi Space 2.4 GDI Motion',
 'transmission': 'manual',
 'trim': 'Motion',
 'year': 2000}
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [auto1.nl] INFO: Saving data for VL80205: {'auction_closing_time': 1774885306.0, 'created_time': 1774638684.051377, 'last_price_update_time': 1774873640.991918}
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL80205') HTTP/1.1" 204 0
2026-03-30 12:27:21 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-30 12:27:21 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-30 12:27:21 [auto1.nl] INFO: Scrape type for FD56899: 2
2026-03-30 12:27:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-30 12:27:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9744a992-e104-5296-830e-f83dba490145 with scrape type 2
2026-03-30 12:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9744a992-e104-5296-830e-f83dba490145 with scrape type 2
2026-03-30 12:27:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9744a992-e104-5296-830e-f83dba490145, identifier: FD56899
2026-03-30 12:27:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-30 12:27:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-30 12:27:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899 to the API
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:55:12Z',
 'fuel_type': 'petrol',
 'id': '9744a992-e104-5296-830e-f83dba490145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD56899',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Wagon',
 'odometer': 150881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Suzuki Wagon 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-30 12:27:21 [auto1.nl] INFO: Saving data for FD56899: {'auction_closing_time': 1774886112.0, 'created_time': 1774465828.242712, 'last_price_update_time': 1774873641.489558}
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD56899') HTTP/1.1" 204 0
2026-03-30 12:27:21 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-30 12:27:21 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-30 12:27:21 [auto1.nl] INFO: Scrape type for FJ96412: 2
2026-03-30 12:27:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-30 12:27:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with scrape type 2
2026-03-30 12:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with scrape type 2
2026-03-30 12:27:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43, identifier: FJ96412
2026-03-30 12:27:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-30 12:27:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-30 12:27:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412 to the API
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:34:22Z',
 'fuel_type': 'petrol',
 'id': 'cd56b48c-ae68-5a9f-acb0-7c2e90c15b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ96412',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 155860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-25',
 'seller_name': None,
 'title': 'Peugeot 307 2.0 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2004}
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-30 12:27:21 [auto1.nl] INFO: Saving data for FJ96412: {'auction_closing_time': 1774884862.0, 'created_time': 1774638700.45358, 'last_price_update_time': 1774873641.874233}
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ96412') HTTP/1.1" 204 0
2026-03-30 12:27:21 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-30 12:27:21 [auto1.nl] INFO: Scrape type for YF19474: 2
2026-03-30 12:27:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474
2026-03-30 12:27:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e03a149d-6c16-5723-8c12-d8cef6132cfa with scrape type 2
2026-03-30 12:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e03a149d-6c16-5723-8c12-d8cef6132cfa with scrape type 2
2026-03-30 12:27:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e03a149d-6c16-5723-8c12-d8cef6132cfa, identifier: YF19474
2026-03-30 12:27:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474
2026-03-30 12:27:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474
2026-03-30 12:27:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474 to the API
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:26:44Z',
 'fuel_type': 'petrol',
 'id': 'e03a149d-6c16-5723-8c12-d8cef6132cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF19474',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 111930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2018}
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-30 12:27:22 [auto1.nl] INFO: Saving data for YF19474: {'auction_closing_time': 1774884404.0, 'created_time': 1774786236.234471, 'last_price_update_time': 1774873642.273598}
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF19474') HTTP/1.1" 204 0
2026-03-30 12:27:22 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-30 12:27:22 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-30 12:27:22 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-30 12:27:22 [auto1.nl] INFO: Scrape type for CN90357: 2
2026-03-30 12:27:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357
2026-03-30 12:27:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 302f3549-6a63-54d0-9729-d1b8ae33d17f with scrape type 2
2026-03-30 12:27:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 302f3549-6a63-54d0-9729-d1b8ae33d17f with scrape type 2
2026-03-30 12:27:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 302f3549-6a63-54d0-9729-d1b8ae33d17f, identifier: CN90357
2026-03-30 12:27:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357
2026-03-30 12:27:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357
2026-03-30 12:27:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357 to the API
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:29:33Z',
 'fuel_type': 'petrol',
 'id': '302f3549-6a63-54d0-9729-d1b8ae33d17f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN90357',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Starlet',
 'odometer': 182773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-01-23',
 'seller_name': None,
 'title': 'Toyota Starlet 1.3 XLi',
 'transmission': 'manual',
 'trim': 'XLi',
 'year': 1992}
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-30 12:27:22 [auto1.nl] INFO: Saving data for CN90357: {'auction_closing_time': 1774884573.0, 'created_time': 1774552338.608898, 'last_price_update_time': 1774873642.869645}
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CN90357') HTTP/1.1" 204 0
2026-03-30 12:27:22 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-30 12:27:22 [auto1.nl] INFO: Scrape type for JG60699: 2
2026-03-30 12:27:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-30 12:27:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f5f36b3-3093-5656-923f-dd351ff4ac28 with scrape type 2
2026-03-30 12:27:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f5f36b3-3093-5656-923f-dd351ff4ac28 with scrape type 2
2026-03-30 12:27:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f5f36b3-3093-5656-923f-dd351ff4ac28, identifier: JG60699
2026-03-30 12:27:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-30 12:27:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-30 12:27:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699 to the API
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:11:56Z',
 'fuel_type': 'petrol',
 'id': '3f5f36b3-3093-5656-923f-dd351ff4ac28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG60699',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'Premacy',
 'odometer': 189288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-20',
 'seller_name': None,
 'title': 'Mazda Premacy 2.0 Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2003}
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [auto1.nl] INFO: Saving data for JG60699: {'auction_closing_time': 1774883516.0, 'created_time': 1773861327.754043, 'last_price_update_time': 1774873643.262703}
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG60699') HTTP/1.1" 204 0
2026-03-30 12:27:23 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-30 12:27:23 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-30 12:27:23 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-30 12:27:23 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-30 12:27:23 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-30 12:27:23 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [auto1.nl] INFO: Scrape type for ZJ02157: 2
2026-03-30 12:27:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-30 12:27:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402093a2-ccab-5cdf-9b16-953d5eb0edbc with scrape type 2
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 402093a2-ccab-5cdf-9b16-953d5eb0edbc with scrape type 2
2026-03-30 12:27:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 402093a2-ccab-5cdf-9b16-953d5eb0edbc, identifier: ZJ02157
2026-03-30 12:27:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-30 12:27:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-30 12:27:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157 to the API
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:19Z',
 'fuel_type': 'petrol',
 'id': '402093a2-ccab-5cdf-9b16-953d5eb0edbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ02157',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 134313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 1.5 TSI ACT Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2020}
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-30 12:27:23 [auto1.nl] INFO: Saving data for ZJ02157: {'auction_closing_time': 1774883959.0, 'created_time': 1774786239.979658, 'last_price_update_time': 1774873643.888834}
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZJ02157') HTTP/1.1" 204 0
2026-03-30 12:27:24 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-30 12:27:24 [auto1.nl] INFO: Scrape type for GX78126: 2
2026-03-30 12:27:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-30 12:27:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9087dd2-d140-5332-becb-315d2d870249 with scrape type 2
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9087dd2-d140-5332-becb-315d2d870249 with scrape type 2
2026-03-30 12:27:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b9087dd2-d140-5332-becb-315d2d870249, identifier: GX78126
2026-03-30 12:27:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-30 12:27:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-30 12:27:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126 to the API
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:04:27Z',
 'fuel_type': 'petrol',
 'id': 'b9087dd2-d140-5332-becb-315d2d870249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX78126',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 255204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-30 12:27:24 [auto1.nl] INFO: Saving data for GX78126: {'auction_closing_time': 1774883067.0, 'created_time': 1773688566.13225, 'last_price_update_time': 1774873644.397298}
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX78126') HTTP/1.1" 204 0
2026-03-30 12:27:24 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-30 12:27:24 [auto1.nl] INFO: Scrape type for ME06294: 2
2026-03-30 12:27:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-30 12:27:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2147ca-2613-525f-823c-999e282f8356 with scrape type 2
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df2147ca-2613-525f-823c-999e282f8356 with scrape type 2
2026-03-30 12:27:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: df2147ca-2613-525f-823c-999e282f8356, identifier: ME06294
2026-03-30 12:27:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-30 12:27:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-30 12:27:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294 to the API
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:44:14Z',
 'fuel_type': 'diesel',
 'id': 'df2147ca-2613-525f-823c-999e282f8356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME06294',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 135098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-06-22',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 Diesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2000}
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-30 12:27:24 [auto1.nl] INFO: Saving data for ME06294: {'auction_closing_time': 1774885454.0, 'created_time': 1774552298.739491, 'last_price_update_time': 1774873644.76914}
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME06294') HTTP/1.1" 204 0
2026-03-30 12:27:24 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-30 12:27:24 [auto1.nl] INFO: Scrape type for NN80164: 2
2026-03-30 12:27:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164
2026-03-30 12:27:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c88083-54ae-5b55-a6af-60175998219d with scrape type 2
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c88083-54ae-5b55-a6af-60175998219d with scrape type 2
2026-03-30 12:27:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2c88083-54ae-5b55-a6af-60175998219d, identifier: NN80164
2026-03-30 12:27:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164
2026-03-30 12:27:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164
2026-03-30 12:27:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164 to the API
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:44Z',
 'fuel_type': 'diesel',
 'id': 'b2c88083-54ae-5b55-a6af-60175998219d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN80164',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Kyron',
 'odometer': 355885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-20',
 'seller_name': None,
 'title': 'Ssangyong Kyron 2.0 200 Xdi',
 'transmission': 'automatic',
 'trim': '200 Xdi',
 'year': 2008}
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-30 12:27:25 [auto1.nl] INFO: Saving data for NN80164: {'auction_closing_time': 1774883924.0, 'created_time': 1774786242.053043, 'last_price_update_time': 1774873645.172749}
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NN80164') HTTP/1.1" 204 0
2026-03-30 12:27:25 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-30 12:27:25 [auto1.nl] INFO: Scrape type for AW61305: 2
2026-03-30 12:27:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-30 12:27:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30e26517-6d5d-5863-823e-b00c4ac6e534 with scrape type 2
2026-03-30 12:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30e26517-6d5d-5863-823e-b00c4ac6e534 with scrape type 2
2026-03-30 12:27:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30e26517-6d5d-5863-823e-b00c4ac6e534, identifier: AW61305
2026-03-30 12:27:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-30 12:27:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-30 12:27:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305 to the API
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:17:43Z',
 'fuel_type': 'petrol',
 'id': '30e26517-6d5d-5863-823e-b00c4ac6e534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW61305',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 159970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-15',
 'seller_name': None,
 'title': 'Renault Scenic 2.0 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2006}
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-30 12:27:25 [auto1.nl] INFO: Saving data for AW61305: {'auction_closing_time': 1774883863.0, 'created_time': 1774638709.611317, 'last_price_update_time': 1774873645.561291}
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW61305') HTTP/1.1" 204 0
2026-03-30 12:27:25 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX02211%27 HTTP/1.1" 200 None
2026-03-30 12:27:25 [auto1.nl] INFO: Scrape type for LX02211: 2
2026-03-30 12:27:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211
2026-03-30 12:27:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc1629e9-7e13-5408-8c97-38286eb63c42 with scrape type 2
2026-03-30 12:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc1629e9-7e13-5408-8c97-38286eb63c42 with scrape type 2
2026-03-30 12:27:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cc1629e9-7e13-5408-8c97-38286eb63c42, identifier: LX02211
2026-03-30 12:27:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211
2026-03-30 12:27:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211
2026-03-30 12:27:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211 to the API
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:26Z',
 'fuel_type': 'petrol',
 'id': 'cc1629e9-7e13-5408-8c97-38286eb63c42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX02211',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 131758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX02211%27 HTTP/1.1" 200 None
2026-03-30 12:27:25 [auto1.nl] INFO: Saving data for LX02211: {'auction_closing_time': 1774884866.0, 'created_time': 1774786249.551827, 'last_price_update_time': 1774873645.943593}
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX02211') HTTP/1.1" 204 0
2026-03-30 12:27:25 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-30 12:27:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.750(s), this was the 1st time calling it.
2026-03-30 12:27:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.08816386726635 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:27:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:27:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT85838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP54166/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:07 [scrapy.extensions.logstats] INFO: Crawled 125 pages (at 3 pages/min), scraped 124 items (at 18 items/min)
2026-03-30 12:28:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:28:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.039(s), this was the 2nd time calling it.
2026-03-30 12:28:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.137438928753944 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.940(s), this was the 1st time calling it.
2026-03-30 12:28:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.665845567528959 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ08221> (referer: https://www.auto1.com/v1/car-details-view/UZ08221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c49af8b-212c-56bd-9b7c-22f9d382cba1 with identifier: UZ08221
2026-03-30 12:28:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1 with scrape type 1
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_f4f51149b8e1f2fd3ec86773ceaeef0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_f4f51149b8e1f2fd3ec86773ceaeef0e.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_3cfc1a38448b3d1de84deddd07143dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_3cfc1a38448b3d1de84deddd07143dd3.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_d33a3bbdbd307e0efb7595475799d30b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_d33a3bbdbd307e0efb7595475799d30b.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_b2f6a2f145653b7b679bdfe297c07479.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_b2f6a2f145653b7b679bdfe297c07479.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_975011ed280fcc76c76d4a3a8a98620b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_975011ed280fcc76c76d4a3a8a98620b.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_9af2b3dbd3281a841b03f22d833dead4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_9af2b3dbd3281a841b03f22d833dead4.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_8f0ed7efee48a60d022a313cdc7929bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_8f0ed7efee48a60d022a313cdc7929bd.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_fd6a0f1c62d4b3baf0f69b7e8711311c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_fd6a0f1c62d4b3baf0f69b7e8711311c.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_e5c61be027ede1299d1abbdec4c5d66e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_e5c61be027ede1299d1abbdec4c5d66e.jpg not downloaded yet
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_4fc779c9fa83532848c214743b80564f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_4fc779c9fa83532848c214743b80564f.jpg not downloaded yet
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_f4f51149b8e1f2fd3ec86773ceaeef0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_d33a3bbdbd307e0efb7595475799d30b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f837d0>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_f4f51149b8e1f2fd3ec86773ceaeef0e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_f4f51149b8e1f2fd3ec86773ceaeef0e.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_b2f6a2f145653b7b679bdfe297c07479.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_975011ed280fcc76c76d4a3a8a98620b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6038150>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_d33a3bbdbd307e0efb7595475799d30b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_d33a3bbdbd307e0efb7595475799d30b.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_3cfc1a38448b3d1de84deddd07143dd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_4fc779c9fa83532848c214743b80564f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_e5c61be027ede1299d1abbdec4c5d66e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f82310>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_b2f6a2f145653b7b679bdfe297c07479.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_b2f6a2f145653b7b679bdfe297c07479.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_fd6a0f1c62d4b3baf0f69b7e8711311c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f7ffd0>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_975011ed280fcc76c76d4a3a8a98620b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_975011ed280fcc76c76d4a3a8a98620b.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f760d0>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_3cfc1a38448b3d1de84deddd07143dd3.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_3cfc1a38448b3d1de84deddd07143dd3.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a63050>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_4fc779c9fa83532848c214743b80564f.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_4fc779c9fa83532848c214743b80564f.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d695ac90>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_e5c61be027ede1299d1abbdec4c5d66e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_e5c61be027ede1299d1abbdec4c5d66e.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_8f0ed7efee48a60d022a313cdc7929bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_9af2b3dbd3281a841b03f22d833dead4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f13090>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_fd6a0f1c62d4b3baf0f69b7e8711311c.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_fd6a0f1c62d4b3baf0f69b7e8711311c.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6973090>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_8f0ed7efee48a60d022a313cdc7929bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_8f0ed7efee48a60d022a313cdc7929bd.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6968f90>
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F76%252Fb67691c9fc839e41bc6362800d18a34c%252Fpa%252FUZ08221_9af2b3dbd3281a841b03f22d833dead4.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_9af2b3dbd3281a841b03f22d833dead4.jpg saved to cache
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1
2026-03-30 12:28:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c49af8b-212c-56bd-9b7c-22f9d382cba1, skipping ID generation
2026-03-30 12:28:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1 with scrape type 1
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c49af8b-212c-56bd-9b7c-22f9d382cba1 sending to next pipeline
2026-03-30 12:28:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c49af8b-212c-56bd-9b7c-22f9d382cba1, identifier: UZ08221
2026-03-30 12:28:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c49af8b-212c-56bd-9b7c-22f9d382cba1 with identifier: UZ08221
2026-03-30 12:28:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c49af8b-212c-56bd-9b7c-22f9d382cba1 with identifier: UZ08221
2026-03-30 12:28:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c49af8b-212c-56bd-9b7c-22f9d382cba1 with identifier: UZ08221 to the API
2026-03-30 12:28:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_9af2b3dbd3281a841b03f22d833dead4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:05:20Z',
 'fuel_type': 'petrol',
 'id': '3c49af8b-212c-56bd-9b7c-22f9d382cba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XF-094-X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ08221',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 202720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_f4f51149b8e1f2fd3ec86773ceaeef0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_3cfc1a38448b3d1de84deddd07143dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_d33a3bbdbd307e0efb7595475799d30b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_b2f6a2f145653b7b679bdfe297c07479.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_975011ed280fcc76c76d4a3a8a98620b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_9af2b3dbd3281a841b03f22d833dead4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_8f0ed7efee48a60d022a313cdc7929bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_fd6a0f1c62d4b3baf0f69b7e8711311c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_e5c61be027ede1299d1abbdec4c5d66e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c49af8b-212c-56bd-9b7c-22f9d382cba1/3c49af8b-212c-56bd-9b7c-22f9d382cba1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/76/b67691c9fc839e41bc6362800d18a34c/pa/UZ08221_4fc779c9fa83532848c214743b80564f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.6 TCe Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2018}
2026-03-30 12:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UZ08221%27 HTTP/1.1" 200 None
2026-03-30 12:28:13 [auto1.nl] INFO: Saving data for UZ08221: {'created_time': 1774873693.487668, 'last_price_update_time': 1774873693.487682, 'auction_closing_time': 1774969520.0}
2026-03-30 12:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UZ08221') HTTP/1.1" 204 0
2026-03-30 12:28:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:28:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB98893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC58597> (referer: https://www.auto1.com/v1/car-details-view/BC58597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36413020-1579-5bd4-88c0-54982bb7d553 with identifier: BC58597
2026-03-30 12:28:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36413020-1579-5bd4-88c0-54982bb7d553 with scrape type 1
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_c1e012aa44d95a534b92a34a800a640e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_c1e012aa44d95a534b92a34a800a640e.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_797ea83ea2dc97860434848c4d3ac3c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_797ea83ea2dc97860434848c4d3ac3c7.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_81146e385fb14c81be38795b420a6ae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_81146e385fb14c81be38795b420a6ae9.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_47b1feee5d6ca0ac86c1b2c39ff5ffa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_47b1feee5d6ca0ac86c1b2c39ff5ffa0.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_cf2de891848ec685b67f1beb52a8a3df.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_cf2de891848ec685b67f1beb52a8a3df.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_1f72834bf037ffe0c9ab6682a18cc945.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1f72834bf037ffe0c9ab6682a18cc945.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_2936ecc8d8fe942bee2be8c61f347f3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_2936ecc8d8fe942bee2be8c61f347f3f.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_632a2eba29aab4f0393f6810d640d3c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_632a2eba29aab4f0393f6810d640d3c3.jpg not downloaded yet
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_1d858d10faa684b6528c677b8d21dd90.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1d858d10faa684b6528c677b8d21dd90.jpg not downloaded yet
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_81146e385fb14c81be38795b420a6ae9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_d714442c3e6bf740b1211cf8723a9314.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_d714442c3e6bf740b1211cf8723a9314.jpg not downloaded yet
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_c1e012aa44d95a534b92a34a800a640e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_797ea83ea2dc97860434848c4d3ac3c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_cf2de891848ec685b67f1beb52a8a3df.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603bd50>
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_81146e385fb14c81be38795b420a6ae9.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_81146e385fb14c81be38795b420a6ae9.jpg saved to cache
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f296d0>
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_c1e012aa44d95a534b92a34a800a640e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_c1e012aa44d95a534b92a34a800a640e.jpg saved to cache
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_47b1feee5d6ca0ac86c1b2c39ff5ffa0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1d858d10faa684b6528c677b8d21dd90.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f61950>
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_797ea83ea2dc97860434848c4d3ac3c7.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_797ea83ea2dc97860434848c4d3ac3c7.jpg saved to cache
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f07150>
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_cf2de891848ec685b67f1beb52a8a3df.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_cf2de891848ec685b67f1beb52a8a3df.jpg saved to cache
2026-03-30 12:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6028390>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_47b1feee5d6ca0ac86c1b2c39ff5ffa0.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_47b1feee5d6ca0ac86c1b2c39ff5ffa0.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6969e10>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_1d858d10faa684b6528c677b8d21dd90.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1d858d10faa684b6528c677b8d21dd90.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_d714442c3e6bf740b1211cf8723a9314.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1f72834bf037ffe0c9ab6682a18cc945.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_2936ecc8d8fe942bee2be8c61f347f3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d693f990>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_d714442c3e6bf740b1211cf8723a9314.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_d714442c3e6bf740b1211cf8723a9314.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_632a2eba29aab4f0393f6810d640d3c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d696b010>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_1f72834bf037ffe0c9ab6682a18cc945.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1f72834bf037ffe0c9ab6682a18cc945.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc903c50>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_2936ecc8d8fe942bee2be8c61f347f3f.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_2936ecc8d8fe942bee2be8c61f347f3f.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT85838> (referer: https://www.auto1.com/v1/car-details-view/PT85838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE92727> (referer: https://www.auto1.com/v1/car-details-view/GE92727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d694b090>
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fd0%252F37d0a8b88c103d46c9578bffacb5ab60%252Fpa%252FBC58597_632a2eba29aab4f0393f6810d640d3c3.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_632a2eba29aab4f0393f6810d640d3c3.jpg saved to cache
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36413020-1579-5bd4-88c0-54982bb7d553
2026-03-30 12:28:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36413020-1579-5bd4-88c0-54982bb7d553, skipping ID generation
2026-03-30 12:28:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36413020-1579-5bd4-88c0-54982bb7d553 with scrape type 1
2026-03-30 12:28:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36413020-1579-5bd4-88c0-54982bb7d553 sending to next pipeline
2026-03-30 12:28:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36413020-1579-5bd4-88c0-54982bb7d553, identifier: BC58597
2026-03-30 12:28:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36413020-1579-5bd4-88c0-54982bb7d553 with identifier: BC58597
2026-03-30 12:28:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36413020-1579-5bd4-88c0-54982bb7d553 with identifier: BC58597
2026-03-30 12:28:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36413020-1579-5bd4-88c0-54982bb7d553 with identifier: BC58597 to the API
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_632a2eba29aab4f0393f6810d640d3c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:23:52Z',
 'fuel_type': 'petrol',
 'id': '36413020-1579-5bd4-88c0-54982bb7d553',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HK902J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC58597',
 'listing': 'auction',
 'location': 'NL, Maastricht',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 191552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_c1e012aa44d95a534b92a34a800a640e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_797ea83ea2dc97860434848c4d3ac3c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_81146e385fb14c81be38795b420a6ae9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340089,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_47b1feee5d6ca0ac86c1b2c39ff5ffa0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541960,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_cf2de891848ec685b67f1beb52a8a3df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1f72834bf037ffe0c9ab6682a18cc945.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_2936ecc8d8fe942bee2be8c61f347f3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_632a2eba29aab4f0393f6810d640d3c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_1d858d10faa684b6528c677b8d21dd90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36413020-1579-5bd4-88c0-54982bb7d553/36413020-1579-5bd4-88c0-54982bb7d553_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/d0/37d0a8b88c103d46c9578bffacb5ab60/pa/BC58597_d714442c3e6bf740b1211cf8723a9314.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2015}
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC58597%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [auto1.nl] INFO: Saving data for BC58597: {'created_time': 1774873698.314578, 'last_price_update_time': 1774873698.314589, 'auction_closing_time': 1774970632.0}
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC58597') HTTP/1.1" 204 0
2026-03-30 12:28:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e51a3a7b-ef8c-5276-b9d9-757fdec66125 with identifier: PT85838
2026-03-30 12:28:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e51a3a7b-ef8c-5276-b9d9-757fdec66125 with scrape type 1
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e51a3a7b-ef8c-5276-b9d9-757fdec66125
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_cefe305e2675328727f87624a323a4fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_cefe305e2675328727f87624a323a4fc.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_3235dd70f98be590dc8cf7dd7c353dff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_3235dd70f98be590dc8cf7dd7c353dff.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_f5f4787e88f33a4d4c6e7fbf3f531535.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_f5f4787e88f33a4d4c6e7fbf3f531535.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_68cc3f2728ddc2e03ba26b1cfd682d86.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_68cc3f2728ddc2e03ba26b1cfd682d86.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_f53fb27e8040761c360dc4700b31c684.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_f53fb27e8040761c360dc4700b31c684.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_6aa4786e7e656c2bc89bccef6bfa29a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_6aa4786e7e656c2bc89bccef6bfa29a9.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_fc2c0facb503d189357dd146eabfdc0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_fc2c0facb503d189357dd146eabfdc0a.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_7e880a7c1b2003f81ad7b3520c68e47d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_7e880a7c1b2003f81ad7b3520c68e47d.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_cfc88f8b75b05766a3eaf58c3a948358.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_cfc88f8b75b05766a3eaf58c3a948358.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07204da7659cfa87f6dc56641bb7a%252Fpa%252FPT85838_5074453e78c1e8c83da7614e99fd6927.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_5074453e78c1e8c83da7614e99fd6927.jpg already downloaded
2026-03-30 12:28:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e51a3a7b-ef8c-5276-b9d9-757fdec66125, identifier: PT85838
2026-03-30 12:28:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b52c1688-f2f9-5595-b265-f34f4ce0d909 with identifier: GE92727
2026-03-30 12:28:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b52c1688-f2f9-5595-b265-f34f4ce0d909 with scrape type 1
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b52c1688-f2f9-5595-b265-f34f4ce0d909
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_0042e920b73ef40136a8ef9b872ae9b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_0042e920b73ef40136a8ef9b872ae9b5.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_993f9ca861884bb9b2f60fc695b999ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_993f9ca861884bb9b2f60fc695b999ed.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_1fc97914396542f0904cc23c26176e2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_1fc97914396542f0904cc23c26176e2c.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_49c3bc9f55d10951d143e80e1e43f9f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_49c3bc9f55d10951d143e80e1e43f9f5.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_4a0ce916516e6dbc98e4bbeddbcd17d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_4a0ce916516e6dbc98e4bbeddbcd17d1.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_d6eb484acae9d3ad9d297be6e4090de0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_d6eb484acae9d3ad9d297be6e4090de0.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_d38d53393e3d3828abcef79720bb0193.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_d38d53393e3d3828abcef79720bb0193.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_b05b843f0c1bc930ac15dba1d2152184.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_b05b843f0c1bc930ac15dba1d2152184.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_6ef8b76aa21765c7a269c380506aa516.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_6ef8b76aa21765c7a269c380506aa516.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fcd%252F80cd38a25793d3727c56c59151b79334%252Fpa%252FGE92727_f3c8032cfc4a20555243b51d0a390f7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_f3c8032cfc4a20555243b51d0a390f7d.jpg already downloaded
2026-03-30 12:28:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b52c1688-f2f9-5595-b265-f34f4ce0d909, identifier: GE92727
2026-03-30 12:28:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e51a3a7b-ef8c-5276-b9d9-757fdec66125 with identifier: PT85838
2026-03-30 12:28:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e51a3a7b-ef8c-5276-b9d9-757fdec66125 with identifier: PT85838
2026-03-30 12:28:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e51a3a7b-ef8c-5276-b9d9-757fdec66125 with identifier: PT85838 to the API
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PT85838>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:56:39Z',
 'fuel_type': 'petrol',
 'id': 'e51a3a7b-ef8c-5276-b9d9-757fdec66125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PS585S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT85838',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 99402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_cefe305e2675328727f87624a323a4fc.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_3235dd70f98be590dc8cf7dd7c353dff.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_f5f4787e88f33a4d4c6e7fbf3f531535.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_68cc3f2728ddc2e03ba26b1cfd682d86.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_f53fb27e8040761c360dc4700b31c684.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_6aa4786e7e656c2bc89bccef6bfa29a9.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_fc2c0facb503d189357dd146eabfdc0a.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_7e880a7c1b2003f81ad7b3520c68e47d.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_cfc88f8b75b05766a3eaf58c3a948358.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_5074453e78c1e8c83da7614e99fd6927.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_cefe305e2675328727f87624a323a4fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_3235dd70f98be590dc8cf7dd7c353dff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_f5f4787e88f33a4d4c6e7fbf3f531535.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_68cc3f2728ddc2e03ba26b1cfd682d86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_f53fb27e8040761c360dc4700b31c684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_6aa4786e7e656c2bc89bccef6bfa29a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_fc2c0facb503d189357dd146eabfdc0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_7e880a7c1b2003f81ad7b3520c68e47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_cfc88f8b75b05766a3eaf58c3a948358.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e51a3a7b-ef8c-5276-b9d9-757fdec66125/e51a3a7b-ef8c-5276-b9d9-757fdec66125_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07204da7659cfa87f6dc56641bb7a/pa/PT85838_5074453e78c1e8c83da7614e99fd6927.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT85838%27 HTTP/1.1" 200 None
2026-03-30 12:28:19 [auto1.nl] INFO: Saving data for PT85838: {'created_time': 1774873699.269928, 'last_price_update_time': 1774873699.269938, 'auction_closing_time': 1774972599.0}
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT85838') HTTP/1.1" 204 0
2026-03-30 12:28:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b52c1688-f2f9-5595-b265-f34f4ce0d909 with identifier: GE92727
2026-03-30 12:28:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b52c1688-f2f9-5595-b265-f34f4ce0d909 with identifier: GE92727
2026-03-30 12:28:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b52c1688-f2f9-5595-b265-f34f4ce0d909 with identifier: GE92727 to the API
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GE92727>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:37:03Z',
 'fuel_type': 'petrol',
 'id': 'b52c1688-f2f9-5595-b265-f34f4ce0d909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K152RF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE92727',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 113869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_0042e920b73ef40136a8ef9b872ae9b5.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_993f9ca861884bb9b2f60fc695b999ed.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_1fc97914396542f0904cc23c26176e2c.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_49c3bc9f55d10951d143e80e1e43f9f5.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_4a0ce916516e6dbc98e4bbeddbcd17d1.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_d6eb484acae9d3ad9d297be6e4090de0.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_d38d53393e3d3828abcef79720bb0193.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_b05b843f0c1bc930ac15dba1d2152184.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_6ef8b76aa21765c7a269c380506aa516.jpg',
                'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_f3c8032cfc4a20555243b51d0a390f7d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_0042e920b73ef40136a8ef9b872ae9b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_993f9ca861884bb9b2f60fc695b999ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_1fc97914396542f0904cc23c26176e2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_49c3bc9f55d10951d143e80e1e43f9f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_4a0ce916516e6dbc98e4bbeddbcd17d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_d6eb484acae9d3ad9d297be6e4090de0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_d38d53393e3d3828abcef79720bb0193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_b05b843f0c1bc930ac15dba1d2152184.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_6ef8b76aa21765c7a269c380506aa516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b52c1688-f2f9-5595-b265-f34f4ce0d909/b52c1688-f2f9-5595-b265-f34f4ce0d909_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/cd/80cd38a25793d3727c56c59151b79334/pa/GE92727_f3c8032cfc4a20555243b51d0a390f7d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE92727%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Saving data for GE92727: {'created_time': 1774873700.063779, 'last_price_update_time': 1774873700.063789, 'auction_closing_time': 1774971423.0}
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GE92727') HTTP/1.1" 204 0
2026-03-30 12:28:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.227(s), this was the 2nd time calling it.
2026-03-30 12:28:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.775058360385026 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB98893> (referer: https://www.auto1.com/v1/car-details-view/AB98893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9fe1996-d78a-57aa-b8e1-21f35e63cecf with identifier: AB98893
2026-03-30 12:28:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf with scrape type 1
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_c39d586dd4ddf437395b2f0859efe85a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_c39d586dd4ddf437395b2f0859efe85a.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_570505cead05cca40da93330dd1cbb0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_570505cead05cca40da93330dd1cbb0a.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_42ddc6694c661113c24d045ee25c25a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_42ddc6694c661113c24d045ee25c25a3.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_da0efcd72d78b7ff10781e5b46a9993a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_da0efcd72d78b7ff10781e5b46a9993a.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_aa4b86204d6c64f4de4ffce2825d0173.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_aa4b86204d6c64f4de4ffce2825d0173.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_bd293ebdb034075903197a5e1138e032.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_bd293ebdb034075903197a5e1138e032.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_ccf7b36eaad5fa980d5593fec082db44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_ccf7b36eaad5fa980d5593fec082db44.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_7995e94db1e48d862d0a50c7ae0389ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_7995e94db1e48d862d0a50c7ae0389ab.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_e0a9e63c83a6fc03ea0931ee556ad7a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_e0a9e63c83a6fc03ea0931ee556ad7a5.jpg not downloaded yet
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_8a72fbd67f5c8416c39f5e21cdf22052.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_8a72fbd67f5c8416c39f5e21cdf22052.jpg not downloaded yet
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_570505cead05cca40da93330dd1cbb0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_bd293ebdb034075903197a5e1138e032.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_aa4b86204d6c64f4de4ffce2825d0173.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_42ddc6694c661113c24d045ee25c25a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_da0efcd72d78b7ff10781e5b46a9993a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60f58d0>
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_570505cead05cca40da93330dd1cbb0a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_570505cead05cca40da93330dd1cbb0a.jpg saved to cache
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d602a790>
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_bd293ebdb034075903197a5e1138e032.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_bd293ebdb034075903197a5e1138e032.jpg saved to cache
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dd1fb350>
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_aa4b86204d6c64f4de4ffce2825d0173.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_aa4b86204d6c64f4de4ffce2825d0173.jpg saved to cache
2026-03-30 12:28:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_e0a9e63c83a6fc03ea0931ee556ad7a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc91a8d0>
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_42ddc6694c661113c24d045ee25c25a3.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_42ddc6694c661113c24d045ee25c25a3.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f3a510>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_da0efcd72d78b7ff10781e5b46a9993a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_da0efcd72d78b7ff10781e5b46a9993a.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_c39d586dd4ddf437395b2f0859efe85a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d7739110>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_e0a9e63c83a6fc03ea0931ee556ad7a5.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_e0a9e63c83a6fc03ea0931ee556ad7a5.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_8a72fbd67f5c8416c39f5e21cdf22052.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_7995e94db1e48d862d0a50c7ae0389ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_ccf7b36eaad5fa980d5593fec082db44.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aeb9d0>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_c39d586dd4ddf437395b2f0859efe85a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_c39d586dd4ddf437395b2f0859efe85a.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f56b50>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_8a72fbd67f5c8416c39f5e21cdf22052.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_8a72fbd67f5c8416c39f5e21cdf22052.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c3cd0>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_7995e94db1e48d862d0a50c7ae0389ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_7995e94db1e48d862d0a50c7ae0389ab.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ab6ed0>
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F40%252F984007d1b3903c02ff731e508d33f0f3%252Fpa%252FAB98893_ccf7b36eaad5fa980d5593fec082db44.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_ccf7b36eaad5fa980d5593fec082db44.jpg saved to cache
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf
2026-03-30 12:28:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9fe1996-d78a-57aa-b8e1-21f35e63cecf, skipping ID generation
2026-03-30 12:28:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf with scrape type 1
2026-03-30 12:28:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9fe1996-d78a-57aa-b8e1-21f35e63cecf sending to next pipeline
2026-03-30 12:28:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e9fe1996-d78a-57aa-b8e1-21f35e63cecf, identifier: AB98893
2026-03-30 12:28:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e9fe1996-d78a-57aa-b8e1-21f35e63cecf with identifier: AB98893
2026-03-30 12:28:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e9fe1996-d78a-57aa-b8e1-21f35e63cecf with identifier: AB98893
2026-03-30 12:28:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e9fe1996-d78a-57aa-b8e1-21f35e63cecf with identifier: AB98893 to the API
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_ccf7b36eaad5fa980d5593fec082db44.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:38:45Z',
 'fuel_type': 'diesel',
 'id': 'e9fe1996-d78a-57aa-b8e1-21f35e63cecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '3TXP75',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB98893',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 156486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_c39d586dd4ddf437395b2f0859efe85a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_570505cead05cca40da93330dd1cbb0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455103,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_42ddc6694c661113c24d045ee25c25a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902027,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_da0efcd72d78b7ff10781e5b46a9993a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_aa4b86204d6c64f4de4ffce2825d0173.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576012,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_bd293ebdb034075903197a5e1138e032.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_ccf7b36eaad5fa980d5593fec082db44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2922899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_7995e94db1e48d862d0a50c7ae0389ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_e0a9e63c83a6fc03ea0931ee556ad7a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fe1996-d78a-57aa-b8e1-21f35e63cecf/e9fe1996-d78a-57aa-b8e1-21f35e63cecf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/40/984007d1b3903c02ff731e508d33f0f3/pa/AB98893_8a72fbd67f5c8416c39f5e21cdf22052.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB98893%27 HTTP/1.1" 200 None
2026-03-30 12:28:23 [auto1.nl] INFO: Saving data for AB98893: {'created_time': 1774873703.420162, 'last_price_update_time': 1774873703.420181, 'auction_closing_time': 1774971525.0}
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB98893') HTTP/1.1" 204 0
2026-03-30 12:28:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:28:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL25522> (referer: https://www.auto1.com/v1/car-details-view/SL25522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bf756da-f2d2-59ee-a71c-e43325365476 with identifier: SL25522
2026-03-30 12:28:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bf756da-f2d2-59ee-a71c-e43325365476 with scrape type 1
2026-03-30 12:28:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 3bf756da-f2d2-59ee-a71c-e43325365476
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_f471c70e6b714806c5baf369b119cd71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f471c70e6b714806c5baf369b119cd71.jpg not downloaded yet
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_f55a0f8fdc263779cf8a07bb8dceba88.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f55a0f8fdc263779cf8a07bb8dceba88.jpg not downloaded yet
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_c4695432686d7522a8bbf46401211580.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_c4695432686d7522a8bbf46401211580.jpg not downloaded yet
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_7ec4eaaa1846efa81620878178fdae7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_7ec4eaaa1846efa81620878178fdae7d.jpg not downloaded yet
2026-03-30 12:28:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f471c70e6b714806c5baf369b119cd71.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_c4695432686d7522a8bbf46401211580.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f39a90>
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_f471c70e6b714806c5baf369b119cd71.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f471c70e6b714806c5baf369b119cd71.jpg saved to cache
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bf756da-f2d2-59ee-a71c-e43325365476
2026-03-30 12:28:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f55a0f8fdc263779cf8a07bb8dceba88.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_7ec4eaaa1846efa81620878178fdae7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d602a810>
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_c4695432686d7522a8bbf46401211580.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_c4695432686d7522a8bbf46401211580.jpg saved to cache
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bf756da-f2d2-59ee-a71c-e43325365476
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6020210>
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_f55a0f8fdc263779cf8a07bb8dceba88.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f55a0f8fdc263779cf8a07bb8dceba88.jpg saved to cache
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bf756da-f2d2-59ee-a71c-e43325365476
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d603c810>
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2a%252Fa32ad44ba8b9204bf35e9f81319650a1%252Fpa%252FSL25522_7ec4eaaa1846efa81620878178fdae7d.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_7ec4eaaa1846efa81620878178fdae7d.jpg saved to cache
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bf756da-f2d2-59ee-a71c-e43325365476
2026-03-30 12:28:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bf756da-f2d2-59ee-a71c-e43325365476, skipping ID generation
2026-03-30 12:28:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bf756da-f2d2-59ee-a71c-e43325365476 with scrape type 1
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bf756da-f2d2-59ee-a71c-e43325365476 sending to next pipeline
2026-03-30 12:28:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3bf756da-f2d2-59ee-a71c-e43325365476, identifier: SL25522
2026-03-30 12:28:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3bf756da-f2d2-59ee-a71c-e43325365476 with identifier: SL25522
2026-03-30 12:28:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3bf756da-f2d2-59ee-a71c-e43325365476 with identifier: SL25522
2026-03-30 12:28:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3bf756da-f2d2-59ee-a71c-e43325365476 with identifier: SL25522 to the API
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_7ec4eaaa1846efa81620878178fdae7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:19:37Z',
 'fuel_type': 'petrol',
 'id': '3bf756da-f2d2-59ee-a71c-e43325365476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SB264L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL25522',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Fiat',
 'model': '500',
 'odometer': 187359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f471c70e6b714806c5baf369b119cd71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_f55a0f8fdc263779cf8a07bb8dceba88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_c4695432686d7522a8bbf46401211580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf756da-f2d2-59ee-a71c-e43325365476/3bf756da-f2d2-59ee-a71c-e43325365476_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2a/a32ad44ba8b9204bf35e9f81319650a1/pa/SL25522_7ec4eaaa1846efa81620878178fdae7d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2008}
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL25522%27 HTTP/1.1" 200 None
2026-03-30 12:28:30 [auto1.nl] INFO: Saving data for SL25522: {'created_time': 1774873710.833097, 'last_price_update_time': 1774873710.833112, 'auction_closing_time': 1774970377.0}
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SL25522') HTTP/1.1" 204 0
2026-03-30 12:28:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:30 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 1036 | hits on page: 40
2026-03-30 12:28:30 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY24262%27 HTTP/1.1" 200 None
2026-03-30 12:28:30 [auto1.nl] INFO: Scrape type for PY24262: 2
2026-03-30 12:28:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262
2026-03-30 12:28:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7551f8a7-14af-53b8-83e5-3d9993efd856 with scrape type 2
2026-03-30 12:28:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7551f8a7-14af-53b8-83e5-3d9993efd856 with scrape type 2
2026-03-30 12:28:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7551f8a7-14af-53b8-83e5-3d9993efd856, identifier: PY24262
2026-03-30 12:28:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262
2026-03-30 12:28:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262
2026-03-30 12:28:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262 to the API
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:45:44Z',
 'fuel_type': 'petrol',
 'id': '7551f8a7-14af-53b8-83e5-3d9993efd856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY24262',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 211324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-23',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY24262%27 HTTP/1.1" 200 None
2026-03-30 12:28:31 [auto1.nl] INFO: Saving data for PY24262: {'auction_closing_time': 1774885544.0, 'created_time': 1773232129.389805, 'last_price_update_time': 1774873711.751641}
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY24262') HTTP/1.1" 204 0
2026-03-30 12:28:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:31 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-30 12:28:31 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB25892%27 HTTP/1.1" 200 None
2026-03-30 12:28:31 [auto1.nl] INFO: Scrape type for YB25892: 2
2026-03-30 12:28:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892
2026-03-30 12:28:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1966e311-745f-514d-b105-b853d9b9ae01 with scrape type 2
2026-03-30 12:28:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1966e311-745f-514d-b105-b853d9b9ae01 with scrape type 2
2026-03-30 12:28:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1966e311-745f-514d-b105-b853d9b9ae01, identifier: YB25892
2026-03-30 12:28:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892
2026-03-30 12:28:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892
2026-03-30 12:28:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892 to the API
2026-03-30 12:28:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 575,
 'expiration_date': '2026-03-30T15:51:22Z',
 'fuel_type': 'petrol',
 'id': '1966e311-745f-514d-b105-b853d9b9ae01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB25892',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 159647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'BMW X5 M',
 'transmission': 'automatic',
 'trim': 'BW',
 'year': 2017}
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB25892%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.nl] INFO: Saving data for YB25892: {'auction_closing_time': 1774885882.0, 'created_time': 1774786249.859549, 'last_price_update_time': 1774873712.143969}
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB25892') HTTP/1.1" 204 0
2026-03-30 12:28:32 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW76665%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.nl] INFO: Scrape type for DW76665: 2
2026-03-30 12:28:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665
2026-03-30 12:28:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with scrape type 2
2026-03-30 12:28:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with scrape type 2
2026-03-30 12:28:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14, identifier: DW76665
2026-03-30 12:28:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665
2026-03-30 12:28:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665
2026-03-30 12:28:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665 to the API
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:55:47Z',
 'fuel_type': 'petrol',
 'id': 'd6bccfc5-c98b-5a31-b331-2ecdc3b1ae14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW76665',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 257867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-03',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW76665%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.nl] INFO: Saving data for DW76665: {'auction_closing_time': 1774886147.0, 'created_time': 1773342949.803383, 'last_price_update_time': 1774873712.862466}
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW76665') HTTP/1.1" 204 0
2026-03-30 12:28:32 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-30 12:28:32 [auto1.nl] INFO: Scrape type for JW20864: 2
2026-03-30 12:28:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-30 12:28:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with scrape type 2
2026-03-30 12:28:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with scrape type 2
2026-03-30 12:28:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4, identifier: JW20864
2026-03-30 12:28:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-30 12:28:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-30 12:28:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864 to the API
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:48:34Z',
 'fuel_type': 'petrol',
 'id': 'e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW20864',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 178267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-30 12:28:33 [auto1.nl] INFO: Saving data for JW20864: {'auction_closing_time': 1774885714.0, 'created_time': 1774552284.400372, 'last_price_update_time': 1774873713.258785}
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW20864') HTTP/1.1" 204 0
2026-03-30 12:28:33 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-30 12:28:33 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-30 12:28:33 [auto1.nl] INFO: Scrape type for JZ35389: 2
2026-03-30 12:28:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-30 12:28:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with scrape type 2
2026-03-30 12:28:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with scrape type 2
2026-03-30 12:28:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9, identifier: JZ35389
2026-03-30 12:28:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-30 12:28:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-30 12:28:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389 to the API
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:17Z',
 'fuel_type': 'petrol',
 'id': '93cd7e3d-d7ce-5e33-ba36-2162454e8cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ35389',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-3',
 'odometer': 273610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-08-28',
 'seller_name': None,
 'title': 'Saab 9-3 2.0 T',
 'transmission': 'manual',
 'trim': 'T',
 'year': 2002}
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-30 12:28:33 [auto1.nl] INFO: Saving data for JZ35389: {'auction_closing_time': 1774885157.0, 'created_time': 1774638688.620834, 'last_price_update_time': 1774873713.745966}
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JZ35389') HTTP/1.1" 204 0
2026-03-30 12:28:33 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK38734%27 HTTP/1.1" 200 None
2026-03-30 12:28:33 [auto1.nl] INFO: Scrape type for RK38734: 2
2026-03-30 12:28:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734
2026-03-30 12:28:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with scrape type 2
2026-03-30 12:28:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with scrape type 2
2026-03-30 12:28:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000, identifier: RK38734
2026-03-30 12:28:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734
2026-03-30 12:28:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734
2026-03-30 12:28:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734 to the API
2026-03-30 12:28:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:45:06Z',
 'fuel_type': 'petrol',
 'id': 'ad13d8cf-3306-56fe-8ab9-a7eef1ab0000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK38734',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 126742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-20',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK38734%27 HTTP/1.1" 200 None
2026-03-30 12:28:34 [auto1.nl] INFO: Saving data for RK38734: {'auction_closing_time': 1774885506.0, 'created_time': 1774786248.296718, 'last_price_update_time': 1774873714.123573}
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RK38734') HTTP/1.1" 204 0
2026-03-30 12:28:34 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG10005%27 HTTP/1.1" 200 None
2026-03-30 12:28:34 [auto1.nl] INFO: Scrape type for KG10005: 2
2026-03-30 12:28:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005
2026-03-30 12:28:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with scrape type 2
2026-03-30 12:28:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with scrape type 2
2026-03-30 12:28:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b, identifier: KG10005
2026-03-30 12:28:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005
2026-03-30 12:28:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005
2026-03-30 12:28:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005 to the API
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:14:15Z',
 'fuel_type': 'petrol',
 'id': 'ecd4a5ef-1b87-567e-9bf2-ad1e0115051b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG10005',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 291669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-07',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG10005%27 HTTP/1.1" 200 None
2026-03-30 12:28:34 [auto1.nl] INFO: Saving data for KG10005: {'auction_closing_time': 1774883655.0, 'created_time': 1774552354.884837, 'last_price_update_time': 1774873714.564065}
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KG10005') HTTP/1.1" 204 0
2026-03-30 12:28:34 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-30 12:28:34 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA59748%27 HTTP/1.1" 200 None
2026-03-30 12:28:34 [auto1.nl] INFO: Scrape type for NA59748: 2
2026-03-30 12:28:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748
2026-03-30 12:28:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with scrape type 2
2026-03-30 12:28:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with scrape type 2
2026-03-30 12:28:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc, identifier: NA59748
2026-03-30 12:28:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748
2026-03-30 12:28:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748
2026-03-30 12:28:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748 to the API
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:14:49Z',
 'fuel_type': 'petrol',
 'id': '303f23bd-cd04-5501-ac32-2d79d6b5bdbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA59748',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 132701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-26',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA59748%27 HTTP/1.1" 200 None
2026-03-30 12:28:34 [auto1.nl] INFO: Saving data for NA59748: {'auction_closing_time': 1774883689.0, 'created_time': 1774786252.929868, 'last_price_update_time': 1774873714.949466}
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA59748') HTTP/1.1" 204 0
2026-03-30 12:28:34 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-30 12:28:34 [auto1.nl] INFO: Scrape type for XW17095: 2
2026-03-30 12:28:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-30 12:28:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d78efdc7-bf27-5ebc-b817-2318bf5d29bf with scrape type 2
2026-03-30 12:28:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d78efdc7-bf27-5ebc-b817-2318bf5d29bf with scrape type 2
2026-03-30 12:28:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d78efdc7-bf27-5ebc-b817-2318bf5d29bf, identifier: XW17095
2026-03-30 12:28:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-30 12:28:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-30 12:28:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095 to the API
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:43:29Z',
 'fuel_type': 'petrol',
 'id': 'd78efdc7-bf27-5ebc-b817-2318bf5d29bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW17095',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 56194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-30 12:28:35 [auto1.nl] INFO: Saving data for XW17095: {'auction_closing_time': 1774885409.0, 'created_time': 1774786251.981029, 'last_price_update_time': 1774873715.331964}
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW17095') HTTP/1.1" 204 0
2026-03-30 12:28:35 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-30 12:28:35 [auto1.nl] INFO: Scrape type for NT73578: 2
2026-03-30 12:28:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-30 12:28:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with scrape type 2
2026-03-30 12:28:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with scrape type 2
2026-03-30 12:28:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 055966f4-c3ce-500a-bade-b5abdc9cd5d3, identifier: NT73578
2026-03-30 12:28:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-30 12:28:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-30 12:28:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578 to the API
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:01Z',
 'fuel_type': 'diesel',
 'id': '055966f4-c3ce-500a-bade-b5abdc9cd5d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT73578',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-06',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-30 12:28:35 [auto1.nl] INFO: Saving data for NT73578: {'auction_closing_time': 1774884841.0, 'created_time': 1773923868.168898, 'last_price_update_time': 1774873715.757902}
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT73578') HTTP/1.1" 204 0
2026-03-30 12:28:35 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-30 12:28:35 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MG34346%27 HTTP/1.1" 200 None
2026-03-30 12:28:35 [auto1.nl] INFO: Scrape type for MG34346: 2
2026-03-30 12:28:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346
2026-03-30 12:28:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0addbc-d695-5dc3-9e50-13aa329285bc with scrape type 2
2026-03-30 12:28:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b0addbc-d695-5dc3-9e50-13aa329285bc with scrape type 2
2026-03-30 12:28:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4b0addbc-d695-5dc3-9e50-13aa329285bc, identifier: MG34346
2026-03-30 12:28:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346
2026-03-30 12:28:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346
2026-03-30 12:28:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346 to the API
2026-03-30 12:28:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:31:38Z',
 'fuel_type': 'petrol',
 'id': '4b0addbc-d695-5dc3-9e50-13aa329285bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG34346',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 99134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MG34346%27 HTTP/1.1" 200 None
2026-03-30 12:28:36 [auto1.nl] INFO: Saving data for MG34346: {'auction_closing_time': 1774884698.0, 'created_time': 1774786253.254243, 'last_price_update_time': 1774873716.149548}
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MG34346') HTTP/1.1" 204 0
2026-03-30 12:28:36 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-30 12:28:36 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-30 12:28:36 [auto1.nl] INFO: Scrape type for ZE21436: 2
2026-03-30 12:28:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-30 12:28:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with scrape type 2
2026-03-30 12:28:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with scrape type 2
2026-03-30 12:28:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b, identifier: ZE21436
2026-03-30 12:28:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-30 12:28:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-30 12:28:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436 to the API
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:58:03Z',
 'fuel_type': 'diesel',
 'id': '4ce19f29-2e87-5963-808e-a7e3eb7d2d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE21436',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 178348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-11-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 Diesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 1997}
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-30 12:28:36 [auto1.nl] INFO: Saving data for ZE21436: {'auction_closing_time': 1774886283.0, 'created_time': 1774465847.593938, 'last_price_update_time': 1774873716.564581}
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE21436') HTTP/1.1" 204 0
2026-03-30 12:28:36 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-30 12:28:36 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-30 12:28:36 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-30 12:28:36 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-30 12:28:36 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY98170%27 HTTP/1.1" 200 None
2026-03-30 12:28:36 [auto1.nl] INFO: Scrape type for NY98170: 2
2026-03-30 12:28:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170
2026-03-30 12:28:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182ed0a8-33af-53cc-b8df-3b8d581e046d with scrape type 2
2026-03-30 12:28:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 182ed0a8-33af-53cc-b8df-3b8d581e046d with scrape type 2
2026-03-30 12:28:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 182ed0a8-33af-53cc-b8df-3b8d581e046d, identifier: NY98170
2026-03-30 12:28:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.994(s), this was the 2nd time calling it.
2026-03-30 12:28:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.830786028196827 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170
2026-03-30 12:28:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170
2026-03-30 12:28:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170 to the API
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:15Z',
 'fuel_type': 'petrol',
 'id': '182ed0a8-33af-53cc-b8df-3b8d581e046d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY98170',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 100734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-15',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY98170%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.nl] INFO: Saving data for NY98170: {'auction_closing_time': 1774885395.0, 'created_time': 1773429238.035221, 'last_price_update_time': 1774873717.047177}
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY98170') HTTP/1.1" 204 0
2026-03-30 12:28:37 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.nl] INFO: Scrape type for YV60983: 2
2026-03-30 12:28:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983
2026-03-30 12:28:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4b9833-8220-5c32-9a6e-47ae93b9b721 with scrape type 2
2026-03-30 12:28:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4b9833-8220-5c32-9a6e-47ae93b9b721 with scrape type 2
2026-03-30 12:28:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ce4b9833-8220-5c32-9a6e-47ae93b9b721, identifier: YV60983
2026-03-30 12:28:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983
2026-03-30 12:28:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983
2026-03-30 12:28:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983 to the API
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:40Z',
 'fuel_type': 'petrol',
 'id': 'ce4b9833-8220-5c32-9a6e-47ae93b9b721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV60983',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 326293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-12',
 'seller_name': None,
 'title': 'Audi A6 2.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.nl] INFO: Saving data for YV60983: {'auction_closing_time': 1774885900.0, 'created_time': 1773342991.752715, 'last_price_update_time': 1774873717.506085}
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YV60983') HTTP/1.1" 204 0
2026-03-30 12:28:37 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.nl] INFO: Scrape type for GK27630: 2
2026-03-30 12:28:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-30 12:28:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deac8add-ab2e-5633-9caf-542ff677dfb3 with scrape type 2
2026-03-30 12:28:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deac8add-ab2e-5633-9caf-542ff677dfb3 with scrape type 2
2026-03-30 12:28:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: deac8add-ab2e-5633-9caf-542ff677dfb3, identifier: GK27630
2026-03-30 12:28:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-30 12:28:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-30 12:28:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630 to the API
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:05:34Z',
 'fuel_type': 'petrol',
 'id': 'deac8add-ab2e-5633-9caf-542ff677dfb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK27630',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 25900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2022}
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.nl] INFO: Saving data for GK27630: {'auction_closing_time': 1774883134.0, 'created_time': 1773688530.587234, 'last_price_update_time': 1774873717.921777}
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GK27630') HTTP/1.1" 204 0
2026-03-30 12:28:37 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.nl] INFO: Scrape type for TC52581: 2
2026-03-30 12:28:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581
2026-03-30 12:28:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1c54d5-8a20-5069-b418-a5e010fef81a with scrape type 2
2026-03-30 12:28:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a1c54d5-8a20-5069-b418-a5e010fef81a with scrape type 2
2026-03-30 12:28:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3a1c54d5-8a20-5069-b418-a5e010fef81a, identifier: TC52581
2026-03-30 12:28:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581
2026-03-30 12:28:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581
2026-03-30 12:28:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581 to the API
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:54Z',
 'fuel_type': 'diesel',
 'id': '3a1c54d5-8a20-5069-b418-a5e010fef81a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC52581',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 290656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-09',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.3 M-Jet Multijet Cult',
 'transmission': 'manual',
 'trim': 'Multijet Cult',
 'year': 2011}
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [auto1.nl] INFO: Saving data for TC52581: {'auction_closing_time': 1774885254.0, 'created_time': 1774552289.577826, 'last_price_update_time': 1774873718.315378}
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC52581') HTTP/1.1" 204 0
2026-03-30 12:28:38 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-30 12:28:38 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC17693%27 HTTP/1.1" 200 None
2026-03-30 12:28:38 [auto1.nl] INFO: Scrape type for GC17693: 2
2026-03-30 12:28:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693
2026-03-30 12:28:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faae935f-779c-548e-85a3-1275bf146c4b with scrape type 2
2026-03-30 12:28:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faae935f-779c-548e-85a3-1275bf146c4b with scrape type 2
2026-03-30 12:28:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: faae935f-779c-548e-85a3-1275bf146c4b, identifier: GC17693
2026-03-30 12:28:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 12:28:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:28:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693
2026-03-30 12:28:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693 to the API
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:48:49Z',
 'fuel_type': 'gas',
 'id': 'faae935f-779c-548e-85a3-1275bf146c4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC17693',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 166855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-11',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC17693%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [auto1.nl] INFO: Saving data for GC17693: {'auction_closing_time': 1774885729.0, 'created_time': 1774786255.701388, 'last_price_update_time': 1774873719.021001}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GC17693') HTTP/1.1" 204 0
2026-03-30 12:28:39 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME46694%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [auto1.nl] INFO: Scrape type for ME46694: 2
2026-03-30 12:28:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694
2026-03-30 12:28:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc710e56-03cd-55f4-b855-ecbe351af59d with scrape type 2
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc710e56-03cd-55f4-b855-ecbe351af59d with scrape type 2
2026-03-30 12:28:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bc710e56-03cd-55f4-b855-ecbe351af59d, identifier: ME46694
2026-03-30 12:28:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694
2026-03-30 12:28:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694
2026-03-30 12:28:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694 to the API
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:57:49Z',
 'fuel_type': 'petrol',
 'id': 'bc710e56-03cd-55f4-b855-ecbe351af59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME46694',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'Tribute',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-29',
 'seller_name': None,
 'title': 'Mazda Tribute 2.0 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2003}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME46694%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [auto1.nl] INFO: Saving data for ME46694: {'auction_closing_time': 1774886269.0, 'created_time': 1774465826.316092, 'last_price_update_time': 1774873719.426115}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME46694') HTTP/1.1" 204 0
2026-03-30 12:28:39 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD44164%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [auto1.nl] INFO: Scrape type for YD44164: 2
2026-03-30 12:28:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164
2026-03-30 12:28:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5702375b-a4b7-5b55-8282-8633844fc3c5 with scrape type 2
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5702375b-a4b7-5b55-8282-8633844fc3c5 with scrape type 2
2026-03-30 12:28:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5702375b-a4b7-5b55-8282-8633844fc3c5, identifier: YD44164
2026-03-30 12:28:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164
2026-03-30 12:28:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164
2026-03-30 12:28:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164 to the API
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:59:08Z',
 'fuel_type': 'petrol',
 'id': '5702375b-a4b7-5b55-8282-8633844fc3c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD44164',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Voyager',
 'odometer': 189039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-11',
 'seller_name': None,
 'title': 'Chrysler Voyager 3.3 V6 LX',
 'transmission': 'automatic',
 'trim': 'LX',
 'year': 2006}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD44164%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [auto1.nl] INFO: Saving data for YD44164: {'auction_closing_time': 1774886348.0, 'created_time': 1773232091.673362, 'last_price_update_time': 1774873719.927304}
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YD44164') HTTP/1.1" 204 0
2026-03-30 12:28:39 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-30 12:28:39 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-30 12:28:39 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX76007%27 HTTP/1.1" 200 None
2026-03-30 12:28:39 [auto1.nl] INFO: Scrape type for EX76007: 2
2026-03-30 12:28:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007
2026-03-30 12:28:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bf320d-769b-5f6f-9141-3b49a970dc5c with scrape type 2
2026-03-30 12:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bf320d-769b-5f6f-9141-3b49a970dc5c with scrape type 2
2026-03-30 12:28:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2bf320d-769b-5f6f-9141-3b49a970dc5c, identifier: EX76007
2026-03-30 12:28:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007
2026-03-30 12:28:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007
2026-03-30 12:28:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007 to the API
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:49:07Z',
 'fuel_type': 'petrol',
 'id': 'b2bf320d-769b-5f6f-9141-3b49a970dc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX76007',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 136240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Tech Edition',
 'transmission': 'automatic',
 'trim': 'Tech Edition',
 'year': 2018}
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX76007%27 HTTP/1.1" 200 None
2026-03-30 12:28:40 [auto1.nl] INFO: Saving data for EX76007: {'auction_closing_time': 1774885747.0, 'created_time': 1774786256.394752, 'last_price_update_time': 1774873720.328792}
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EX76007') HTTP/1.1" 204 0
2026-03-30 12:28:40 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-30 12:28:40 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-30 12:28:40 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-30 12:28:40 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-30 12:28:40 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-30 12:28:40 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU37312%27 HTTP/1.1" 200 None
2026-03-30 12:28:40 [auto1.nl] INFO: Scrape type for SU37312: 2
2026-03-30 12:28:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312
2026-03-30 12:28:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 749a781b-3c64-5b09-a02e-0b519e2f21de with scrape type 2
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 749a781b-3c64-5b09-a02e-0b519e2f21de with scrape type 2
2026-03-30 12:28:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 749a781b-3c64-5b09-a02e-0b519e2f21de, identifier: SU37312
2026-03-30 12:28:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312
2026-03-30 12:28:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312
2026-03-30 12:28:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312 to the API
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:02Z',
 'fuel_type': 'petrol',
 'id': '749a781b-3c64-5b09-a02e-0b519e2f21de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU37312',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 31461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-06',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo Google',
 'transmission': 'automatic',
 'trim': 'Google',
 'year': 2021}
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU37312%27 HTTP/1.1" 200 None
2026-03-30 12:28:40 [auto1.nl] INFO: Saving data for SU37312: {'auction_closing_time': 1774886282.0, 'created_time': 1774552297.960729, 'last_price_update_time': 1774873720.73916}
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SU37312') HTTP/1.1" 204 0
2026-03-30 12:28:40 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-30 12:28:40 [auto1.nl] INFO: Scrape type for SS31744: 2
2026-03-30 12:28:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-30 12:28:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with scrape type 2
2026-03-30 12:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with scrape type 2
2026-03-30 12:28:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c92c6ce7-fe04-5511-b5e2-06e6d61ef918, identifier: SS31744
2026-03-30 12:28:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-30 12:28:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-30 12:28:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744 to the API
2026-03-30 12:28:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:31Z',
 'fuel_type': 'petrol',
 'id': 'c92c6ce7-fe04-5511-b5e2-06e6d61ef918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS31744',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 114328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Saving data for SS31744: {'auction_closing_time': 1774885711.0, 'created_time': 1773301901.096264, 'last_price_update_time': 1774873721.15656}
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS31744') HTTP/1.1" 204 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-30 12:28:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK45819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK45819> (referer: https://www.auto1.com/v1/car-details-view/ZK45819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc2ed4d-485b-51bd-9079-b29e475c9443 with identifier: ZK45819
2026-03-30 12:28:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc2ed4d-485b-51bd-9079-b29e475c9443 with scrape type 1
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_c2e450d0bfd3793b010716262a6dfe45.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_c2e450d0bfd3793b010716262a6dfe45.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_9f089c09341620095734d2aeb05a4737.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_9f089c09341620095734d2aeb05a4737.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_6d3ea95bae5564f6a2ad0d35d6e11768.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_6d3ea95bae5564f6a2ad0d35d6e11768.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_35fbdc6bec20b96e44d39e52e060024a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_35fbdc6bec20b96e44d39e52e060024a.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_a4982fc9621b77a2d2d4ab7ac9162586.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_a4982fc9621b77a2d2d4ab7ac9162586.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_d87e546b4d9fd7ad25c01360e55dadbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_d87e546b4d9fd7ad25c01360e55dadbf.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_e70e34c8095eaf51ed773b9e67f5d317.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_e70e34c8095eaf51ed773b9e67f5d317.jpg not downloaded yet
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_9f089c09341620095734d2aeb05a4737.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_77587c721c8f40b0955bdb7143619aa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_77587c721c8f40b0955bdb7143619aa9.jpg not downloaded yet
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_16e8dfbbbddde3325a64826ccd61eb8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_16e8dfbbbddde3325a64826ccd61eb8a.jpg not downloaded yet
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_6d3ea95bae5564f6a2ad0d35d6e11768.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_35fbdc6bec20b96e44d39e52e060024a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_262f97aa80ae559aa63b7c06982d6290.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_262f97aa80ae559aa63b7c06982d6290.jpg not downloaded yet
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_a4982fc9621b77a2d2d4ab7ac9162586.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_d87e546b4d9fd7ad25c01360e55dadbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_e70e34c8095eaf51ed773b9e67f5d317.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_262f97aa80ae559aa63b7c06982d6290.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6965850>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_9f089c09341620095734d2aeb05a4737.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_9f089c09341620095734d2aeb05a4737.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a86050>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_6d3ea95bae5564f6a2ad0d35d6e11768.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_6d3ea95bae5564f6a2ad0d35d6e11768.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6ab6bd0>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_35fbdc6bec20b96e44d39e52e060024a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_35fbdc6bec20b96e44d39e52e060024a.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcbee850>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_a4982fc9621b77a2d2d4ab7ac9162586.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_a4982fc9621b77a2d2d4ab7ac9162586.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_16e8dfbbbddde3325a64826ccd61eb8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_77587c721c8f40b0955bdb7143619aa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6041a50>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_d87e546b4d9fd7ad25c01360e55dadbf.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_d87e546b4d9fd7ad25c01360e55dadbf.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6aa0890>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_e70e34c8095eaf51ed773b9e67f5d317.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_e70e34c8095eaf51ed773b9e67f5d317.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6980e10>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_262f97aa80ae559aa63b7c06982d6290.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_262f97aa80ae559aa63b7c06982d6290.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d602edd0>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_16e8dfbbbddde3325a64826ccd61eb8a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_16e8dfbbbddde3325a64826ccd61eb8a.jpg saved to cache
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc96fdd0>
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_77587c721c8f40b0955bdb7143619aa9.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_77587c721c8f40b0955bdb7143619aa9.jpg saved to cache
2026-03-30 12:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_c2e450d0bfd3793b010716262a6dfe45.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:28:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:28:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:28:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:28:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:28:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f6f490>
2026-03-30 12:28:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fdb%252Ff9db932c3f26ce0ab2a8fe55c8ffa821%252Fpa%252FZK45819_c2e450d0bfd3793b010716262a6dfe45.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_c2e450d0bfd3793b010716262a6dfe45.jpg saved to cache
2026-03-30 12:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acc2ed4d-485b-51bd-9079-b29e475c9443
2026-03-30 12:28:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acc2ed4d-485b-51bd-9079-b29e475c9443, skipping ID generation
2026-03-30 12:28:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc2ed4d-485b-51bd-9079-b29e475c9443 with scrape type 1
2026-03-30 12:28:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acc2ed4d-485b-51bd-9079-b29e475c9443 sending to next pipeline
2026-03-30 12:28:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acc2ed4d-485b-51bd-9079-b29e475c9443, identifier: ZK45819
2026-03-30 12:28:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acc2ed4d-485b-51bd-9079-b29e475c9443 with identifier: ZK45819
2026-03-30 12:28:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acc2ed4d-485b-51bd-9079-b29e475c9443 with identifier: ZK45819
2026-03-30 12:28:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acc2ed4d-485b-51bd-9079-b29e475c9443 with identifier: ZK45819 to the API
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_c2e450d0bfd3793b010716262a6dfe45.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 261,
 'expiration_date': '2026-03-31T15:37:08Z',
 'fuel_type': 'hybrid',
 'id': 'acc2ed4d-485b-51bd-9079-b29e475c9443',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK45819',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Lynk & Co',
 'model': '01',
 'odometer': 30823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 9667937,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_c2e450d0bfd3793b010716262a6dfe45.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_9f089c09341620095734d2aeb05a4737.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_6d3ea95bae5564f6a2ad0d35d6e11768.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_35fbdc6bec20b96e44d39e52e060024a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_a4982fc9621b77a2d2d4ab7ac9162586.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_d87e546b4d9fd7ad25c01360e55dadbf.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_e70e34c8095eaf51ed773b9e67f5d317.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_77587c721c8f40b0955bdb7143619aa9.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_16e8dfbbbddde3325a64826ccd61eb8a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acc2ed4d-485b-51bd-9079-b29e475c9443/acc2ed4d-485b-51bd-9079-b29e475c9443_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/db/f9db932c3f26ce0ab2a8fe55c8ffa821/pa/ZK45819_262f97aa80ae559aa63b7c06982d6290.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lynk & Co 01 1.5 Plug-in Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK45819%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.nl] INFO: Saving data for ZK45819: {'created_time': 1774873739.251573, 'last_price_update_time': 1774873739.251583, 'auction_closing_time': 1774971428.0}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK45819') HTTP/1.1" 204 0
2026-03-30 12:28:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.458(s), this was the 2nd time calling it.
2026-03-30 12:28:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.38817749274774 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:29:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB99145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB99145> (referer: https://www.auto1.com/v1/car-details-view/YB99145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383aaba1-32d6-5961-b78b-19d0042b1407 with identifier: YB99145
2026-03-30 12:29:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383aaba1-32d6-5961-b78b-19d0042b1407 with scrape type 1
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 383aaba1-32d6-5961-b78b-19d0042b1407
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_1cf86194733a57600a12ddb75d8387f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_1cf86194733a57600a12ddb75d8387f5.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_244d9273aaa2af9503c947a1b6ecc4b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_244d9273aaa2af9503c947a1b6ecc4b0.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_0aa8884a63b79afa35d6d7e8a7edb15a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_0aa8884a63b79afa35d6d7e8a7edb15a.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_fe9ff6f993533e8e85ea96ef5974a8a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_fe9ff6f993533e8e85ea96ef5974a8a8.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_f85d1fd57fdd499391f46120b0a436f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_f85d1fd57fdd499391f46120b0a436f2.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_117f9829be5de0ebe9b152bdb68995f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_117f9829be5de0ebe9b152bdb68995f8.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_6ffc5c32f1d6638e489a785543e26e6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_6ffc5c32f1d6638e489a785543e26e6b.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_0f74a29d4bd05f0eb5d050bbc8215f6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_0f74a29d4bd05f0eb5d050bbc8215f6e.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_71a8bac45c9d690972f0d39f735d3d69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_71a8bac45c9d690972f0d39f735d3d69.jpg already downloaded
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fef%252Fbcef1ac51876ac150769c75c369cfeee%252Fpa%252FYB99145_8d2131c970a4fa6dd41df03d60ae2799.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_8d2131c970a4fa6dd41df03d60ae2799.jpg already downloaded
2026-03-30 12:29:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 383aaba1-32d6-5961-b78b-19d0042b1407, identifier: YB99145
2026-03-30 12:29:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 383aaba1-32d6-5961-b78b-19d0042b1407 with identifier: YB99145
2026-03-30 12:29:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 383aaba1-32d6-5961-b78b-19d0042b1407 with identifier: YB99145
2026-03-30 12:29:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 383aaba1-32d6-5961-b78b-19d0042b1407 with identifier: YB99145 to the API
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB99145>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:32:22Z',
 'fuel_type': 'petrol',
 'id': '383aaba1-32d6-5961-b78b-19d0042b1407',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '14-TJF-5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB99145',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 289956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_1cf86194733a57600a12ddb75d8387f5.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_244d9273aaa2af9503c947a1b6ecc4b0.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_0aa8884a63b79afa35d6d7e8a7edb15a.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_fe9ff6f993533e8e85ea96ef5974a8a8.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_f85d1fd57fdd499391f46120b0a436f2.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_117f9829be5de0ebe9b152bdb68995f8.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_6ffc5c32f1d6638e489a785543e26e6b.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_0f74a29d4bd05f0eb5d050bbc8215f6e.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_71a8bac45c9d690972f0d39f735d3d69.jpg',
                'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_8d2131c970a4fa6dd41df03d60ae2799.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878109,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_1cf86194733a57600a12ddb75d8387f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3119032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_244d9273aaa2af9503c947a1b6ecc4b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2811437,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_0aa8884a63b79afa35d6d7e8a7edb15a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_fe9ff6f993533e8e85ea96ef5974a8a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_f85d1fd57fdd499391f46120b0a436f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_117f9829be5de0ebe9b152bdb68995f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2779405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_6ffc5c32f1d6638e489a785543e26e6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3119345,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_0f74a29d4bd05f0eb5d050bbc8215f6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_71a8bac45c9d690972f0d39f735d3d69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_383aaba1-32d6-5961-b78b-19d0042b1407/383aaba1-32d6-5961-b78b-19d0042b1407_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3195307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ef/bcef1ac51876ac150769c75c369cfeee/pa/YB99145_8d2131c970a4fa6dd41df03d60ae2799.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S60 1.6 T3 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2012}
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB99145%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.nl] INFO: Saving data for YB99145: {'created_time': 1774873744.292637, 'last_price_update_time': 1774873744.292647, 'auction_closing_time': 1774971142.0}
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB99145') HTTP/1.1" 204 0
2026-03-30 12:29:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:29:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:05 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 1036 | hits on page: 40
2026-03-30 12:29:05 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-30 12:29:05 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-30 12:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-30 12:29:05 [auto1.nl] INFO: Scrape type for GY89787: 2
2026-03-30 12:29:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-30 12:29:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d01af-7b71-5e80-9de1-9995851d01ef with scrape type 2
2026-03-30 12:29:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b01d01af-7b71-5e80-9de1-9995851d01ef with scrape type 2
2026-03-30 12:29:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b01d01af-7b71-5e80-9de1-9995851d01ef, identifier: GY89787
2026-03-30 12:29:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-30 12:29:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-30 12:29:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787 to the API
2026-03-30 12:29:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:34:18Z',
 'fuel_type': 'petrol',
 'id': 'b01d01af-7b71-5e80-9de1-9995851d01ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY89787',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 252042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-14',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T4 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2011}
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.nl] INFO: Saving data for GY89787: {'auction_closing_time': 1774884858.0, 'created_time': 1773133072.515458, 'last_price_update_time': 1774873747.488705}
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY89787') HTTP/1.1" 204 0
2026-03-30 12:29:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:07 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.nl] INFO: Scrape type for VL52985: 2
2026-03-30 12:29:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-30 12:29:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b50388c-81a6-5005-86ae-e904bf073f82 with scrape type 2
2026-03-30 12:29:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b50388c-81a6-5005-86ae-e904bf073f82 with scrape type 2
2026-03-30 12:29:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b50388c-81a6-5005-86ae-e904bf073f82, identifier: VL52985
2026-03-30 12:29:07 [scrapy.extensions.logstats] INFO: Crawled 138 pages (at 13 pages/min), scraped 155 items (at 31 items/min)
2026-03-30 12:29:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:29:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-30 12:29:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-30 12:29:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985 to the API
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:40:09Z',
 'fuel_type': 'petrol',
 'id': '2b50388c-81a6-5005-86ae-e904bf073f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL52985',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 182503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-05',
 'seller_name': None,
 'title': 'Kia Venga 1.6 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2012}
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.nl] INFO: Saving data for VL52985: {'auction_closing_time': 1774885209.0, 'created_time': 1773342980.661633, 'last_price_update_time': 1774873748.938278}
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL52985') HTTP/1.1" 204 0
2026-03-30 12:29:08 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.nl] INFO: Scrape type for CA77037: 2
2026-03-30 12:29:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037
2026-03-30 12:29:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fded7c72-7132-5eb6-99ad-35696cf9b672 with scrape type 2
2026-03-30 12:29:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fded7c72-7132-5eb6-99ad-35696cf9b672 with scrape type 2
2026-03-30 12:29:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fded7c72-7132-5eb6-99ad-35696cf9b672, identifier: CA77037
2026-03-30 12:29:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037
2026-03-30 12:29:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037
2026-03-30 12:29:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037 to the API
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:52:03Z',
 'fuel_type': 'petrol',
 'id': 'fded7c72-7132-5eb6-99ad-35696cf9b672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA77037',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 199038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-17',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.nl] INFO: Saving data for CA77037: {'auction_closing_time': 1774885923.0, 'created_time': 1773837157.292507, 'last_price_update_time': 1774873750.76526}
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA77037') HTTP/1.1" 204 0
2026-03-30 12:29:10 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.nl] INFO: Scrape type for MC51093: 2
2026-03-30 12:29:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093
2026-03-30 12:29:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with scrape type 2
2026-03-30 12:29:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with scrape type 2
2026-03-30 12:29:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa, identifier: MC51093
2026-03-30 12:29:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093
2026-03-30 12:29:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093
2026-03-30 12:29:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093 to the API
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:18Z',
 'fuel_type': 'petrol',
 'id': '3f291cd5-1ed2-5803-af3f-db5a7ad55afa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC51093',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 63789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.nl] INFO: Saving data for MC51093: {'auction_closing_time': 1774883358.0, 'created_time': 1773231950.278401, 'last_price_update_time': 1774873751.895444}
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC51093') HTTP/1.1" 204 0
2026-03-30 12:29:11 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-30 12:29:11 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.nl] INFO: Scrape type for ZL38920: 2
2026-03-30 12:29:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-30 12:29:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with scrape type 2
2026-03-30 12:29:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e, identifier: ZL38920
2026-03-30 12:29:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-30 12:29:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-30 12:29:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920 to the API
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'petrol',
 'id': 'd7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL38920',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 132275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-10',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2019}
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.nl] INFO: Saving data for ZL38920: {'auction_closing_time': 1774884544.0, 'created_time': 1773232252.95277, 'last_price_update_time': 1774873752.376989}
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL38920') HTTP/1.1" 204 0
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.nl] INFO: Scrape type for SZ31943: 2
2026-03-30 12:29:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943
2026-03-30 12:29:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaeda52c-7a74-55e9-9530-9f0f5fe57548 with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaeda52c-7a74-55e9-9530-9f0f5fe57548 with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aaeda52c-7a74-55e9-9530-9f0f5fe57548, identifier: SZ31943
2026-03-30 12:29:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943
2026-03-30 12:29:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943
2026-03-30 12:29:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943 to the API
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:59:20Z',
 'fuel_type': 'petrol',
 'id': 'aaeda52c-7a74-55e9-9530-9f0f5fe57548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ31943',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S4',
 'odometer': 262214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-02',
 'seller_name': None,
 'title': 'Audi S4 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-30 12:29:13 [auto1.nl] INFO: Saving data for SZ31943: {'auction_closing_time': 1774886360.0, 'created_time': 1773133309.725944, 'last_price_update_time': 1774873753.589037}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SZ31943') HTTP/1.1" 204 0
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-30 12:29:13 [auto1.nl] INFO: Scrape type for TU57635: 2
2026-03-30 12:29:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-30 12:29:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df5f0fb-4821-5c39-b3f7-243f340d6789 with scrape type 2
2026-03-30 12:29:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6df5f0fb-4821-5c39-b3f7-243f340d6789 with scrape type 2
2026-03-30 12:29:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6df5f0fb-4821-5c39-b3f7-243f340d6789, identifier: TU57635
2026-03-30 12:29:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-30 12:29:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-30 12:29:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635 to the API
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:20:33Z',
 'fuel_type': 'petrol',
 'id': '6df5f0fb-4821-5c39-b3f7-243f340d6789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU57635',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 276474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-14',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-30 12:29:15 [auto1.nl] INFO: Saving data for TU57635: {'auction_closing_time': 1774884033.0, 'created_time': 1773232418.772815, 'last_price_update_time': 1774873755.181775}
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU57635') HTTP/1.1" 204 0
2026-03-30 12:29:15 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-30 12:29:15 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH35225%27 HTTP/1.1" 200 None
2026-03-30 12:29:15 [auto1.nl] INFO: Scrape type for RH35225: 2
2026-03-30 12:29:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225
2026-03-30 12:29:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984b02be-0cd5-581c-8236-1c5b6628e4dd with scrape type 2
2026-03-30 12:29:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984b02be-0cd5-581c-8236-1c5b6628e4dd with scrape type 2
2026-03-30 12:29:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 984b02be-0cd5-581c-8236-1c5b6628e4dd, identifier: RH35225
2026-03-30 12:29:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG57032> (referer: https://www.auto1.com/v1/car-details-view/LG57032/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225
2026-03-30 12:29:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225
2026-03-30 12:29:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225 to the API
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:32Z',
 'fuel_type': 'diesel',
 'id': '984b02be-0cd5-581c-8236-1c5b6628e4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH35225',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 343519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-26',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH35225%27 HTTP/1.1" 200 None
2026-03-30 12:29:16 [auto1.nl] INFO: Saving data for RH35225: {'auction_closing_time': 1774885472.0, 'created_time': 1773232378.24073, 'last_price_update_time': 1774873756.629279}
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RH35225') HTTP/1.1" 204 0
2026-03-30 12:29:16 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-30 12:29:16 [auto1.nl] INFO: Scrape type for CX09180: 2
2026-03-30 12:29:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180
2026-03-30 12:29:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa43f4b5-903c-58ff-a359-b15ab45f8476 with scrape type 2
2026-03-30 12:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa43f4b5-903c-58ff-a359-b15ab45f8476 with scrape type 2
2026-03-30 12:29:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aa43f4b5-903c-58ff-a359-b15ab45f8476, identifier: CX09180
2026-03-30 12:29:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180
2026-03-30 12:29:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180
2026-03-30 12:29:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180 to the API
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:18:12Z',
 'fuel_type': 'petrol',
 'id': 'aa43f4b5-903c-58ff-a359-b15ab45f8476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX09180',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 105301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Generation Four BlueMotion',
 'transmission': 'manual',
 'trim': 'Generation Four BlueMotion',
 'year': 2016}
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-30 12:29:18 [auto1.nl] INFO: Saving data for CX09180: {'auction_closing_time': 1774883892.0, 'created_time': 1774379561.281164, 'last_price_update_time': 1774873758.335727}
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX09180') HTTP/1.1" 204 0
2026-03-30 12:29:18 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ14164%27 HTTP/1.1" 200 None
2026-03-30 12:29:18 [auto1.nl] INFO: Scrape type for BZ14164: 2
2026-03-30 12:29:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164
2026-03-30 12:29:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ac7e61-d23a-5894-ba42-52cf15c82050 with scrape type 2
2026-03-30 12:29:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8ac7e61-d23a-5894-ba42-52cf15c82050 with scrape type 2
2026-03-30 12:29:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d8ac7e61-d23a-5894-ba42-52cf15c82050, identifier: BZ14164
2026-03-30 12:29:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164
2026-03-30 12:29:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164
2026-03-30 12:29:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164 to the API
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:39Z',
 'fuel_type': 'diesel',
 'id': 'd8ac7e61-d23a-5894-ba42-52cf15c82050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ14164',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 246118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-04',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ14164%27 HTTP/1.1" 200 None
2026-03-30 12:29:19 [auto1.nl] INFO: Saving data for BZ14164: {'auction_closing_time': 1774885119.0, 'created_time': 1773232311.560557, 'last_price_update_time': 1774873759.857256}
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ14164') HTTP/1.1" 204 0
2026-03-30 12:29:19 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 1036 | hits on page: 40
2026-03-30 12:29:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e67129d5-e736-50ac-9197-bae1cebaf410 with identifier: LG57032
2026-03-30 12:29:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e67129d5-e736-50ac-9197-bae1cebaf410 with scrape type 1
2026-03-30 12:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e67129d5-e736-50ac-9197-bae1cebaf410
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_238181687ed3a5eb7bd3ee2befd5420e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_238181687ed3a5eb7bd3ee2befd5420e.jpg not downloaded yet
2026-03-30 12:29:19 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-30 12:29:19 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-30 12:29:19 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-30 12:29:19 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-30 12:29:19 [auto1.nl] INFO: Scrape type for GD44915: 2
2026-03-30 12:29:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-30 12:29:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8687cf15-7688-575b-9acb-f780961e2d6b with scrape type 2
2026-03-30 12:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8687cf15-7688-575b-9acb-f780961e2d6b with scrape type 2
2026-03-30 12:29:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8687cf15-7688-575b-9acb-f780961e2d6b, identifier: GD44915
2026-03-30 12:29:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-30 12:29:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-30 12:29:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915 to the API
2026-03-30 12:29:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:15:36Z',
 'fuel_type': 'petrol',
 'id': '8687cf15-7688-575b-9acb-f780961e2d6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD44915',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 53894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2022}
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Saving data for GD44915: {'auction_closing_time': 1774883736.0, 'created_time': 1774552282.374843, 'last_price_update_time': 1774873761.510152}
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD44915') HTTP/1.1" 204 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for LZ20154: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for GW21106: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for VV89778: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for XZ29701: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for UM83404: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for SV00912: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for AX06352: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for YT76844: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD02824%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for XD02824: 0
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_69ed3e8f42df91d9164f232e3c21d28a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_69ed3e8f42df91d9164f232e3c21d28a.jpg not downloaded yet
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for AC01356: 2
2026-03-30 12:29:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356
2026-03-30 12:29:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cef1e56-06b3-57ce-a00f-19d4172f2684 with scrape type 2
2026-03-30 12:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cef1e56-06b3-57ce-a00f-19d4172f2684 with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3cef1e56-06b3-57ce-a00f-19d4172f2684, identifier: AC01356
2026-03-30 12:29:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356
2026-03-30 12:29:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356
2026-03-30 12:29:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356 to the API
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 575,
 'expiration_date': '2026-03-30T15:46:05Z',
 'fuel_type': 'petrol',
 'id': '3cef1e56-06b3-57ce-a00f-19d4172f2684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC01356',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 137398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'BMW X6 M',
 'transmission': 'automatic',
 'trim': 'BW',
 'year': 2017}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Saving data for AC01356: {'auction_closing_time': 1774885565.0, 'created_time': 1773134219.261115, 'last_price_update_time': 1774873762.404979}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AC01356') HTTP/1.1" 204 0
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_99a45468360da4578d7b5b616191d7ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_99a45468360da4578d7b5b616191d7ce.jpg not downloaded yet
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Scrape type for JL68792: 2
2026-03-30 12:29:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-30 12:29:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5dbde58-d27d-5136-84c9-f5b5d801d9b1, identifier: JL68792
2026-03-30 12:29:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-30 12:29:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-30 12:29:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792 to the API
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-30T15:02:30Z',
 'fuel_type': 'hybrid',
 'id': 'e5dbde58-d27d-5136-84c9-f5b5d801d9b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL68792',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 231516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Saving data for JL68792: {'auction_closing_time': 1774882950.0, 'created_time': 1773302384.6079, 'last_price_update_time': 1774873762.917455}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JL68792') HTTP/1.1" 204 0
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_0955bf46e426112aaf8052727b6a59bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_0955bf46e426112aaf8052727b6a59bd.jpg not downloaded yet
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP11309%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Scrape type for VP11309: 2
2026-03-30 12:29:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309
2026-03-30 12:29:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1dfe09c-faa6-5841-96d6-4109a30f3a3b with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1dfe09c-faa6-5841-96d6-4109a30f3a3b with scrape type 2
2026-03-30 12:29:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1dfe09c-faa6-5841-96d6-4109a30f3a3b, identifier: VP11309
2026-03-30 12:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_238181687ed3a5eb7bd3ee2befd5420e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309
2026-03-30 12:29:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309
2026-03-30 12:29:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309 to the API
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:55:06Z',
 'fuel_type': 'petrol',
 'id': 'a1dfe09c-faa6-5841-96d6-4109a30f3a3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP11309',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 190367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-24',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP11309%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Saving data for VP11309: {'auction_closing_time': 1774886106.0, 'created_time': 1773232298.619375, 'last_price_update_time': 1774873763.365342}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VP11309') HTTP/1.1" 204 0
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_a8cd0bfc0d6e3cdb034bf3c19dbfee3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_a8cd0bfc0d6e3cdb034bf3c19dbfee3c.jpg not downloaded yet
2026-03-30 12:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_69ed3e8f42df91d9164f232e3c21d28a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Scrape type for ZY88945: 2
2026-03-30 12:29:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-30 12:29:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86f80907-8290-5b49-b95c-ebc0855b07fe with scrape type 2
2026-03-30 12:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86f80907-8290-5b49-b95c-ebc0855b07fe with scrape type 2
2026-03-30 12:29:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 86f80907-8290-5b49-b95c-ebc0855b07fe, identifier: ZY88945
2026-03-30 12:29:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-30 12:29:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-30 12:29:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945 to the API
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:17:00Z',
 'fuel_type': 'petrol',
 'id': '86f80907-8290-5b49-b95c-ebc0855b07fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY88945',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 221775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 R-Design 2WD',
 'transmission': 'manual',
 'trim': 'R-Design 2WD',
 'year': 2012}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Saving data for ZY88945: {'auction_closing_time': 1774883820.0, 'created_time': 1773131940.100476, 'last_price_update_time': 1774873763.938884}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY88945') HTTP/1.1" 204 0
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Scrape type for KX21734: 0
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Scrape type for HR57884: 0
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Scrape type for DJ99279: 0
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc959390>
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_238181687ed3a5eb7bd3ee2befd5420e.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_238181687ed3a5eb7bd3ee2befd5420e.jpg saved to cache
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e67129d5-e736-50ac-9197-bae1cebaf410
2026-03-30 12:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_99a45468360da4578d7b5b616191d7ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_0955bf46e426112aaf8052727b6a59bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dc8f8b10>
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_69ed3e8f42df91d9164f232e3c21d28a.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_69ed3e8f42df91d9164f232e3c21d28a.jpg saved to cache
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e67129d5-e736-50ac-9197-bae1cebaf410
2026-03-30 12:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_a8cd0bfc0d6e3cdb034bf3c19dbfee3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6053e90>
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_99a45468360da4578d7b5b616191d7ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_99a45468360da4578d7b5b616191d7ce.jpg saved to cache
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e67129d5-e736-50ac-9197-bae1cebaf410
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d5f1db50>
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_0955bf46e426112aaf8052727b6a59bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_0955bf46e426112aaf8052727b6a59bd.jpg saved to cache
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e67129d5-e736-50ac-9197-bae1cebaf410
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9dcddb510>
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fef%252Fcfeff31d9b9b03218109271550b0a6b9%252Fpa%252FLG57032_a8cd0bfc0d6e3cdb034bf3c19dbfee3c.jpg') HTTP/1.1" 204 0
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_a8cd0bfc0d6e3cdb034bf3c19dbfee3c.jpg saved to cache
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e67129d5-e736-50ac-9197-bae1cebaf410
2026-03-30 12:29:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e67129d5-e736-50ac-9197-bae1cebaf410, skipping ID generation
2026-03-30 12:29:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e67129d5-e736-50ac-9197-bae1cebaf410 with scrape type 1
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e67129d5-e736-50ac-9197-bae1cebaf410 sending to next pipeline
2026-03-30 12:29:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e67129d5-e736-50ac-9197-bae1cebaf410, identifier: LG57032
2026-03-30 12:29:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e67129d5-e736-50ac-9197-bae1cebaf410 with identifier: LG57032
2026-03-30 12:29:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e67129d5-e736-50ac-9197-bae1cebaf410 with identifier: LG57032
2026-03-30 12:29:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e67129d5-e736-50ac-9197-bae1cebaf410 with identifier: LG57032 to the API
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_a8cd0bfc0d6e3cdb034bf3c19dbfee3c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:52:06Z',
 'fuel_type': 'petrol',
 'id': 'e67129d5-e736-50ac-9197-bae1cebaf410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '67KBN6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG57032',
 'listing': 'auction',
 'location': 'NL, Den Bosch',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 186837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_238181687ed3a5eb7bd3ee2befd5420e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_69ed3e8f42df91d9164f232e3c21d28a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_99a45468360da4578d7b5b616191d7ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_0955bf46e426112aaf8052727b6a59bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e67129d5-e736-50ac-9197-bae1cebaf410/e67129d5-e736-50ac-9197-bae1cebaf410_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ef/cfeff31d9b9b03218109271550b0a6b9/pa/LG57032_a8cd0bfc0d6e3cdb034bf3c19dbfee3c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57032%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Saving data for LG57032: {'created_time': 1774873764.7801, 'last_price_update_time': 1774873764.780111, 'auction_closing_time': 1774972326.0}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG57032') HTTP/1.1" 204 0
2026-03-30 12:29:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.836(s), this was the 1st time calling it.
2026-03-30 12:29:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.076969493609911 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:29:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:34 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 1036 | hits on page: 40
2026-03-30 12:29:34 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-30 12:29:34 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for TB82163: 2
2026-03-30 12:29:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-30 12:29:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 086af578-e4ba-54fb-83d4-b849f1da9f91 with scrape type 2
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 086af578-e4ba-54fb-83d4-b849f1da9f91 with scrape type 2
2026-03-30 12:29:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 086af578-e4ba-54fb-83d4-b849f1da9f91, identifier: TB82163
2026-03-30 12:29:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-30 12:29:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-30 12:29:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163 to the API
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:03Z',
 'fuel_type': 'diesel',
 'id': '086af578-e4ba-54fb-83d4-b849f1da9f91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB82163',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 277690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Saving data for TB82163: {'auction_closing_time': 1774883643.0, 'created_time': 1774595432.056518, 'last_price_update_time': 1774873775.383213}
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TB82163') HTTP/1.1" 204 0
2026-03-30 12:29:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for AX28541: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for MZ48021: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-30 12:29:35 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-30 12:29:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:37 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 1036 | hits on page: 40
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for RC74760: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for VL07732: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for RX80263: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for DG66253: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for GD99184: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for EY85081: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for FK48987: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for FP18275: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for BV58634: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for JM47469: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for FL63517: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-30 12:29:37 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.nl] INFO: Scrape type for WP95967: 0
2026-03-30 12:29:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:49 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 1035 | hits on page: 40
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for ZL63379: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for MW60386: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for CM00428: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for FJ00169: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for CR31925: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for UR99157: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.nl] INFO: Scrape type for NP69601: 0
2026-03-30 12:29:49 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-30 12:29:50 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-30 12:29:50 [auto1.nl] INFO: Scrape type for NR15886: 0
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-30 12:29:50 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-30 12:29:50 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-30 12:29:50 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-30 12:29:50 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-30 12:29:50 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-30 12:29:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:51 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 1035 | hits on page: 40
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for YZ85937: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for UY18740: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for UJ05110: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for RP15329: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for BY94157: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for YP25238: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for HD17412: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for ES69537: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-30 12:29:51 [auto1.nl] INFO: Scrape type for GN05115: 0
2026-03-30 12:29:51 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-30 12:29:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG38127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:52 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 1035 | hits on page: 40
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for RY75066: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for WK29789: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for EL29526: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for CP17463: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for KV87922: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for DB11708: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX51139%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for PX51139: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for TW55830: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for PA43644: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for BU16200: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for HC58225: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for SY53039: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-30 12:29:52 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-30 12:29:52 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-30 12:29:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:53 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 1035 | hits on page: 40
2026-03-30 12:29:53 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-30 12:29:53 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-30 12:29:53 [auto1.nl] INFO: Scrape type for DZ87358: 0
2026-03-30 12:29:53 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-30 12:29:53 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-30 12:29:53 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-30 12:29:53 [auto1.nl] INFO: Scrape type for RC74228: 0
2026-03-30 12:29:53 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-30 12:29:53 [auto1.nl] INFO: Scrape type for MD57319: 0
2026-03-30 12:29:53 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-30 12:29:53 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-30 12:29:53 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-30 12:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for NT33284: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for FR68688: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for AE06801: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for WF02577: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE94931%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for NE94931: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for UB80121: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for YE50957: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for GG02103: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-30 12:29:54 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-30 12:29:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG38127> (referer: https://www.auto1.com/v1/car-details-view/TG38127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d41e7f-f16b-5e0c-bec6-daa5c281bf9b with identifier: TG38127
2026-03-30 12:29:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d41e7f-f16b-5e0c-bec6-daa5c281bf9b with scrape type 1
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33d41e7f-f16b-5e0c-bec6-daa5c281bf9b
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_ec609662e971a927b9951039b2008133.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_ec609662e971a927b9951039b2008133.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_5b8b4709d7c45eb83a032f3d91a9556e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_5b8b4709d7c45eb83a032f3d91a9556e.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_b32798c0189beca4eda686903535ff65.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_b32798c0189beca4eda686903535ff65.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_8c9fc0635e3e4f8b96d8f6abdd979cb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8c9fc0635e3e4f8b96d8f6abdd979cb2.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_4dcc109cdb2a2ecbc53ff3e77f62d7fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_4dcc109cdb2a2ecbc53ff3e77f62d7fc.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_8dde6bf4bc82dac5d62685ac6cfe784c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8dde6bf4bc82dac5d62685ac6cfe784c.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_8266632858f259c7ce929f0365cea360.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8266632858f259c7ce929f0365cea360.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_593c8f38e4316b405cc95dd48fdc29a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_593c8f38e4316b405cc95dd48fdc29a2.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_09f18248b99c10a523aa2ae1769f26c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_09f18248b99c10a523aa2ae1769f26c4.jpg already downloaded
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe8%252Fbee8f0ec12c97e3999feaa605da4ba72%252Fpa%252FTG38127_f4126cb1a2d1aab54416eafb0bfddbe5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_f4126cb1a2d1aab54416eafb0bfddbe5.jpg already downloaded
2026-03-30 12:29:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 33d41e7f-f16b-5e0c-bec6-daa5c281bf9b, identifier: TG38127
2026-03-30 12:29:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 33d41e7f-f16b-5e0c-bec6-daa5c281bf9b with identifier: TG38127
2026-03-30 12:29:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 33d41e7f-f16b-5e0c-bec6-daa5c281bf9b with identifier: TG38127
2026-03-30 12:29:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 33d41e7f-f16b-5e0c-bec6-daa5c281bf9b with identifier: TG38127 to the API
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TG38127>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:23:49Z',
 'fuel_type': 'hybrid',
 'id': '33d41e7f-f16b-5e0c-bec6-daa5c281bf9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TS527D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG38127',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 156937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_ec609662e971a927b9951039b2008133.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_5b8b4709d7c45eb83a032f3d91a9556e.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_b32798c0189beca4eda686903535ff65.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8c9fc0635e3e4f8b96d8f6abdd979cb2.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_4dcc109cdb2a2ecbc53ff3e77f62d7fc.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8dde6bf4bc82dac5d62685ac6cfe784c.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8266632858f259c7ce929f0365cea360.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_593c8f38e4316b405cc95dd48fdc29a2.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_09f18248b99c10a523aa2ae1769f26c4.jpg',
                'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_f4126cb1a2d1aab54416eafb0bfddbe5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_ec609662e971a927b9951039b2008133.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_5b8b4709d7c45eb83a032f3d91a9556e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_b32798c0189beca4eda686903535ff65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8c9fc0635e3e4f8b96d8f6abdd979cb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_4dcc109cdb2a2ecbc53ff3e77f62d7fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8dde6bf4bc82dac5d62685ac6cfe784c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_8266632858f259c7ce929f0365cea360.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_593c8f38e4316b405cc95dd48fdc29a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_09f18248b99c10a523aa2ae1769f26c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d41e7f-f16b-5e0c-bec6-daa5c281bf9b/33d41e7f-f16b-5e0c-bec6-daa5c281bf9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/e8/bee8f0ec12c97e3999feaa605da4ba72/pa/TG38127_f4126cb1a2d1aab54416eafb0bfddbe5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Team D',
 'transmission': 'automatic',
 'trim': 'Team D',
 'year': 2018}
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG38127%27 HTTP/1.1" 200 None
2026-03-30 12:29:57 [auto1.nl] INFO: Saving data for TG38127: {'created_time': 1774873797.572048, 'last_price_update_time': 1774873797.572057, 'auction_closing_time': 1774970629.0}
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TG38127') HTTP/1.1" 204 0
2026-03-30 12:30:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:02 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for UC91516: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ09106%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for YZ09106: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for GN89359: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for NS14796: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for VH01672: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for MW03156: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ58386%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for HJ58386: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for YN37403: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-30 12:30:02 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-30 12:30:02 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-30 12:30:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:04 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.nl] INFO: Scrape type for FK39304: 0
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.nl] INFO: Scrape type for PY93062: 0
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-30 12:30:04 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for MD45251: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for EJ39658: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for ME20407: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for LG71332: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF49809%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for KF49809: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for AM07460: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for FC64695: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.nl] INFO: Scrape type for FE91435: 0
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-30 12:30:05 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-30 12:30:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:06 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for WJ55319: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for HK90585: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for FB20368: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for PN82428: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for YR49127: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for VB13156: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for WC97739: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for BP06390: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for VB96147: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for DW43709: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for SM08260: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.nl] INFO: Scrape type for AB34968: 0
2026-03-30 12:30:06 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-30 12:30:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:07 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 13 pages/min), scraped 172 items (at 17 items/min)
2026-03-30 12:30:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:30:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:08 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for SZ87293: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for SY05694: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for YB51800: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for SG32295: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for EU67961: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for TU99712: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for BX66014: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC54517%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for VC54517: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for BY11680: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC21131%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for VC21131: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81542%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for UR81542: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR03129%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for BR03129: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for XP28763: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL62659%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for HL62659: 0
2026-03-30 12:30:08 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF69205%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.nl] INFO: Scrape type for MF69205: 0
2026-03-30 12:30:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:09 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH69810%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for DH69810: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB68589%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for DB68589: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for WG42782: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF41961%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for RF41961: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC40672%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for BC40672: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR08670%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for PR08670: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR36555%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for DR36555: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ98625%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for BZ98625: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for GM68754: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP71821%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for JP71821: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for BG04233: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for AT06250: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW17706%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for JW17706: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU81834%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for GU81834: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC15859%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for BC15859: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR27425%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for XR27425: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for ME79677: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT04530%27 HTTP/1.1" 200 None
2026-03-30 12:30:09 [auto1.nl] INFO: Scrape type for PT04530: 0
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-30 12:30:09 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-30 12:30:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:10 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:10 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS03610%27 HTTP/1.1" 200 None
2026-03-30 12:30:10 [auto1.nl] INFO: Scrape type for PS03610: 0
2026-03-30 12:30:10 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-30 12:30:10 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18286%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for MD18286: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for EB08844: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for PV55742: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for AM51490: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD35327%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for MD35327: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for TR09691: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for KX19183: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for JH24547: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for HL97424: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for AB85439: 0
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-30 12:30:11 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Scrape type for UE65811: 2
2026-03-30 12:30:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-30 12:30:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850fcbff-7ba8-5c99-853f-846716cf8cf1 with scrape type 2
2026-03-30 12:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850fcbff-7ba8-5c99-853f-846716cf8cf1 with scrape type 2
2026-03-30 12:30:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 850fcbff-7ba8-5c99-853f-846716cf8cf1, identifier: UE65811
2026-03-30 12:30:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-30 12:30:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-30 12:30:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811 to the API
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:31Z',
 'fuel_type': 'petrol',
 'id': '850fcbff-7ba8-5c99-853f-846716cf8cf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE65811',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 85958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.nl] INFO: Saving data for UE65811: {'auction_closing_time': 1774883131.0, 'created_time': 1774699822.279204, 'last_price_update_time': 1774873811.966911}
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE65811') HTTP/1.1" 204 0
2026-03-30 12:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:12 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-30 12:30:12 [auto1.nl] INFO: Scrape type for UY86442: 2
2026-03-30 12:30:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-30 12:30:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a with scrape type 2
2026-03-30 12:30:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a with scrape type 2
2026-03-30 12:30:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d0faeeb-f16f-541d-bea7-50558d26ec2a, identifier: UY86442
2026-03-30 12:30:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-30 12:30:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-30 12:30:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442 to the API
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:07:37Z',
 'fuel_type': 'diesel',
 'id': '3d0faeeb-f16f-541d-bea7-50558d26ec2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY86442',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 288855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.nl] INFO: Saving data for UY86442: {'auction_closing_time': 1774883257.0, 'created_time': 1774699868.035768, 'last_price_update_time': 1774873813.49163}
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY86442') HTTP/1.1" 204 0
2026-03-30 12:30:13 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.nl] INFO: Scrape type for WG90560: 2
2026-03-30 12:30:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-30 12:30:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444c48c3-3381-5989-ab41-910b8b367ec3 with scrape type 2
2026-03-30 12:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 444c48c3-3381-5989-ab41-910b8b367ec3 with scrape type 2
2026-03-30 12:30:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 444c48c3-3381-5989-ab41-910b8b367ec3, identifier: WG90560
2026-03-30 12:30:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-30 12:30:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-30 12:30:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560 to the API
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:06Z',
 'fuel_type': 'petrol',
 'id': '444c48c3-3381-5989-ab41-910b8b367ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG90560',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 94859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2016}
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.nl] INFO: Saving data for WG90560: {'auction_closing_time': 1774884426.0, 'created_time': 1774699864.982412, 'last_price_update_time': 1774873814.269448}
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG90560') HTTP/1.1" 204 0
2026-03-30 12:30:14 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-30 12:30:14 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-30 12:30:14 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-30 12:30:14 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.nl] INFO: Scrape type for UR39080: 2
2026-03-30 12:30:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-30 12:30:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df17881-0615-5640-83e9-cd5295bb909e with scrape type 2
2026-03-30 12:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1df17881-0615-5640-83e9-cd5295bb909e with scrape type 2
2026-03-30 12:30:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1df17881-0615-5640-83e9-cd5295bb909e, identifier: UR39080
2026-03-30 12:30:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-30 12:30:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-30 12:30:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080 to the API
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:20Z',
 'fuel_type': 'petrol',
 'id': '1df17881-0615-5640-83e9-cd5295bb909e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR39080',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 135996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2019}
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.nl] INFO: Saving data for UR39080: {'auction_closing_time': 1774885940.0, 'created_time': 1774440681.940592, 'last_price_update_time': 1774873815.552484}
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR39080') HTTP/1.1" 204 0
2026-03-30 12:30:15 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-30 12:30:15 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-30 12:30:15 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-30 12:30:15 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-30 12:30:15 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-30 12:30:15 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.nl] INFO: Scrape type for PH88105: 2
2026-03-30 12:30:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-30 12:30:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6b085d-7443-5b82-9770-1cfd82694c34 with scrape type 2
2026-03-30 12:30:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6b085d-7443-5b82-9770-1cfd82694c34 with scrape type 2
2026-03-30 12:30:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0f6b085d-7443-5b82-9770-1cfd82694c34, identifier: PH88105
2026-03-30 12:30:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-30 12:30:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-30 12:30:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105 to the API
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:29:39Z',
 'fuel_type': 'petrol',
 'id': '0f6b085d-7443-5b82-9770-1cfd82694c34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH88105',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 204758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.nl] INFO: Saving data for PH88105: {'auction_closing_time': 1774884579.0, 'created_time': 1774699859.368363, 'last_price_update_time': 1774873815.976813}
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PH88105') HTTP/1.1" 204 0
2026-03-30 12:30:16 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.nl] INFO: Scrape type for UF12505: 2
2026-03-30 12:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-30 12:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4984b984-35a6-57e2-bee5-74b747984935 with scrape type 2
2026-03-30 12:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4984b984-35a6-57e2-bee5-74b747984935 with scrape type 2
2026-03-30 12:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4984b984-35a6-57e2-bee5-74b747984935, identifier: UF12505
2026-03-30 12:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-30 12:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-30 12:30:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505 to the API
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:50:59Z',
 'fuel_type': 'petrol',
 'id': '4984b984-35a6-57e2-bee5-74b747984935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF12505',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 202222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Feline',
 'transmission': 'automatic',
 'trim': 'Feline',
 'year': 2015}
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.nl] INFO: Saving data for UF12505: {'auction_closing_time': 1774885859.0, 'created_time': 1774699864.620212, 'last_price_update_time': 1774873816.51625}
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF12505') HTTP/1.1" 204 0
2026-03-30 12:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:16 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:16 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-30 12:30:16 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-30 12:30:17 [auto1.nl] INFO: Scrape type for XK28167: 2
2026-03-30 12:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-30 12:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0e3456-123f-53b7-b2e4-203eec5b124b with scrape type 2
2026-03-30 12:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0e3456-123f-53b7-b2e4-203eec5b124b with scrape type 2
2026-03-30 12:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed0e3456-123f-53b7-b2e4-203eec5b124b, identifier: XK28167
2026-03-30 12:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-30 12:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-30 12:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167 to the API
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'ed0e3456-123f-53b7-b2e4-203eec5b124b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK28167',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S80',
 'odometer': 322705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-28',
 'seller_name': None,
 'title': 'Volvo S80 2.5 TF Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.nl] INFO: Saving data for XK28167: {'auction_closing_time': 1774885690.0, 'created_time': 1774699858.628594, 'last_price_update_time': 1774873818.127801}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XK28167') HTTP/1.1" 204 0
2026-03-30 12:30:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:18 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.nl] INFO: Scrape type for JC30911: 2
2026-03-30 12:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-30 12:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ae144-6ea5-53ed-81d6-2d72c0a23940 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295ae144-6ea5-53ed-81d6-2d72c0a23940 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 295ae144-6ea5-53ed-81d6-2d72c0a23940, identifier: JC30911
2026-03-30 12:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-30 12:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-30 12:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911 to the API
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:48:56Z',
 'fuel_type': 'petrol',
 'id': '295ae144-6ea5-53ed-81d6-2d72c0a23940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC30911',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 117943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-15',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 CC',
 'transmission': 'automatic',
 'trim': 'CC',
 'year': 2003}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.nl] INFO: Saving data for JC30911: {'auction_closing_time': 1774885736.0, 'created_time': 1774699862.606207, 'last_price_update_time': 1774873818.559678}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC30911') HTTP/1.1" 204 0
2026-03-30 12:30:18 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.nl] INFO: Scrape type for AX92237: 2
2026-03-30 12:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-30 12:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047, identifier: AX92237
2026-03-30 12:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-30 12:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-30 12:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237 to the API
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'petrol',
 'id': '9fdb8bb0-d0e2-56db-8ee1-34905a27a047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX92237',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 157242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-05',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Edition 40 Jahre',
 'transmission': 'manual',
 'trim': 'Edition 40 Jahre',
 'year': 2012}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.nl] INFO: Saving data for AX92237: {'auction_closing_time': 1774886125.0, 'created_time': 1774699858.979291, 'last_price_update_time': 1774873820.014702}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX92237') HTTP/1.1" 204 0
2026-03-30 12:30:20 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-30 12:30:20 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.nl] INFO: Scrape type for UB73502: 2
2026-03-30 12:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-30 12:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64f9130-0f9b-5b88-bb20-60061a5dd155 with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64f9130-0f9b-5b88-bb20-60061a5dd155 with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e64f9130-0f9b-5b88-bb20-60061a5dd155, identifier: UB73502
2026-03-30 12:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-30 12:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-30 12:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502 to the API
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:10:54Z',
 'fuel_type': 'hybrid',
 'id': 'e64f9130-0f9b-5b88-bb20-60061a5dd155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB73502',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 52410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.nl] INFO: Saving data for UB73502: {'auction_closing_time': 1774883454.0, 'created_time': 1774465873.211142, 'last_price_update_time': 1774873820.474618}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB73502') HTTP/1.1" 204 0
2026-03-30 12:30:20 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.nl] INFO: Scrape type for TP02076: 2
2026-03-30 12:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-30 12:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5243dc9-af76-596e-895a-5a4b86723b1a with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5243dc9-af76-596e-895a-5a4b86723b1a with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5243dc9-af76-596e-895a-5a4b86723b1a, identifier: TP02076
2026-03-30 12:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-30 12:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-30 12:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076 to the API
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:59:19Z',
 'fuel_type': 'diesel',
 'id': 'e5243dc9-af76-596e-895a-5a4b86723b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP02076',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 279912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-19',
 'seller_name': None,
 'title': 'Ford S-Max 1.8 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-30 12:30:21 [auto1.nl] INFO: Saving data for TP02076: {'auction_closing_time': 1774886359.0, 'created_time': 1774699827.069048, 'last_price_update_time': 1774873821.765572}
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP02076') HTTP/1.1" 204 0
2026-03-30 12:30:21 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-30 12:30:21 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-30 12:30:21 [auto1.nl] INFO: Scrape type for BV07887: 2
2026-03-30 12:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-30 12:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33db28ef-ee4f-5660-808f-2816e530db27 with scrape type 2
2026-03-30 12:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33db28ef-ee4f-5660-808f-2816e530db27 with scrape type 2
2026-03-30 12:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 33db28ef-ee4f-5660-808f-2816e530db27, identifier: BV07887
2026-03-30 12:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-30 12:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-30 12:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887 to the API
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:15:19Z',
 'fuel_type': 'diesel',
 'id': '33db28ef-ee4f-5660-808f-2816e530db27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV07887',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 282108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-11',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 HDi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2012}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.nl] INFO: Saving data for BV07887: {'auction_closing_time': 1774883719.0, 'created_time': 1774033986.549565, 'last_price_update_time': 1774873822.223282}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV07887') HTTP/1.1" 204 0
2026-03-30 12:30:22 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.nl] INFO: Scrape type for ZE09391: 2
2026-03-30 12:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-30 12:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2427ff2f-a130-5e1b-8fbd-39683ea48d83, identifier: ZE09391
2026-03-30 12:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-30 12:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-30 12:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391 to the API
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:49:26Z',
 'fuel_type': 'petrol',
 'id': '2427ff2f-a130-5e1b-8fbd-39683ea48d83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE09391',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 157731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.nl] INFO: Saving data for ZE09391: {'auction_closing_time': 1774885766.0, 'created_time': 1774699876.542312, 'last_price_update_time': 1774873822.667768}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE09391') HTTP/1.1" 204 0
2026-03-30 12:30:22 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.nl] INFO: Scrape type for ER86910: 2
2026-03-30 12:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-30 12:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58905a35-329b-5616-9c3b-d114610ed4c2 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58905a35-329b-5616-9c3b-d114610ed4c2 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58905a35-329b-5616-9c3b-d114610ed4c2, identifier: ER86910
2026-03-30 12:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-30 12:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-30 12:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910 to the API
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:04Z',
 'fuel_type': 'petrol',
 'id': '58905a35-329b-5616-9c3b-d114610ed4c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER86910',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 129299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-22',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.2 Turbo Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.nl] INFO: Saving data for ER86910: {'auction_closing_time': 1774884964.0, 'created_time': 1774699852.624793, 'last_price_update_time': 1774873823.816302}
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ER86910') HTTP/1.1" 204 0
2026-03-30 12:30:23 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-30 12:30:23 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.nl] INFO: Scrape type for DR23359: 2
2026-03-30 12:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-30 12:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc639650-0ba1-56f0-a8f7-8b35e619087c with scrape type 2
2026-03-30 12:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc639650-0ba1-56f0-a8f7-8b35e619087c with scrape type 2
2026-03-30 12:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dc639650-0ba1-56f0-a8f7-8b35e619087c, identifier: DR23359
2026-03-30 12:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-30 12:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-30 12:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359 to the API
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': 'dc639650-0ba1-56f0-a8f7-8b35e619087c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR23359',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 179090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-02',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2012}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.nl] INFO: Saving data for DR23359: {'auction_closing_time': 1774884913.0, 'created_time': 1774034001.769749, 'last_price_update_time': 1774873824.355409}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR23359') HTTP/1.1" 204 0
2026-03-30 12:30:24 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-30 12:30:24 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.nl] INFO: Scrape type for MH16372: 2
2026-03-30 12:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-30 12:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210, identifier: MH16372
2026-03-30 12:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-30 12:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-30 12:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372 to the API
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:37Z',
 'fuel_type': 'petrol',
 'id': '20dadf3f-b2a1-5a7d-ad79-3960c0c71210',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH16372',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 271085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.nl] INFO: Saving data for MH16372: {'auction_closing_time': 1774885477.0, 'created_time': 1774552324.378703, 'last_price_update_time': 1774873824.770161}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MH16372') HTTP/1.1" 204 0
2026-03-30 12:30:24 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.nl] INFO: Scrape type for PU27111: 0
2026-03-30 12:30:24 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.nl] INFO: Scrape type for ME24209: 2
2026-03-30 12:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-30 12:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8c8001cd-8a76-5c14-8199-6303f5c9df6d, identifier: ME24209
2026-03-30 12:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-30 12:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-30 12:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209 to the API
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:19:03Z',
 'fuel_type': 'petrol',
 'id': '8c8001cd-8a76-5c14-8199-6303f5c9df6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME24209',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 370484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-01',
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-30 12:30:25 [auto1.nl] INFO: Saving data for ME24209: {'auction_closing_time': 1774883943.0, 'created_time': 1774699851.886586, 'last_price_update_time': 1774873825.86206}
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME24209') HTTP/1.1" 204 0
2026-03-30 12:30:25 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-30 12:30:25 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-30 12:30:25 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-30 12:30:25 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-30 12:30:25 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-30 12:30:25 [auto1.nl] INFO: Scrape type for EH33258: 2
2026-03-30 12:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-30 12:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d91734-2904-5060-9ee7-bf5d724f6b35 with scrape type 2
2026-03-30 12:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6d91734-2904-5060-9ee7-bf5d724f6b35 with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6d91734-2904-5060-9ee7-bf5d724f6b35, identifier: EH33258
2026-03-30 12:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-30 12:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-30 12:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258 to the API
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:07:10Z',
 'fuel_type': 'petrol',
 'id': 'd6d91734-2904-5060-9ee7-bf5d724f6b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH33258',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 332576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-03',
 'seller_name': None,
 'title': 'Volvo XC90 3.2 Sport Geartronic',
 'transmission': 'automatic',
 'trim': 'Sport Geartronic',
 'year': 2008}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.nl] INFO: Saving data for EH33258: {'auction_closing_time': 1774883230.0, 'created_time': 1774699864.23693, 'last_price_update_time': 1774873826.324775}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH33258') HTTP/1.1" 204 0
2026-03-30 12:30:26 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.nl] INFO: Scrape type for SE67800: 2
2026-03-30 12:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-30 12:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88977c0-4d35-544c-b133-257b8d5a731b with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d88977c0-4d35-544c-b133-257b8d5a731b with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d88977c0-4d35-544c-b133-257b8d5a731b, identifier: SE67800
2026-03-30 12:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-30 12:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-30 12:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800 to the API
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:32Z',
 'fuel_type': 'petrol',
 'id': 'd88977c0-4d35-544c-b133-257b8d5a731b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE67800',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 239178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.nl] INFO: Saving data for SE67800: {'auction_closing_time': 1774885832.0, 'created_time': 1774699851.500948, 'last_price_update_time': 1774873826.879691}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE67800') HTTP/1.1" 204 0
2026-03-30 12:30:26 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.nl] INFO: Scrape type for TN45594: 2
2026-03-30 12:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-30 12:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c436dec9-a348-5375-b382-724c7843d728 with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c436dec9-a348-5375-b382-724c7843d728 with scrape type 2
2026-03-30 12:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c436dec9-a348-5375-b382-724c7843d728, identifier: TN45594
2026-03-30 12:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-30 12:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-30 12:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594 to the API
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:18:36Z',
 'fuel_type': 'diesel',
 'id': 'c436dec9-a348-5375-b382-724c7843d728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN45594',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 222353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.nl] INFO: Saving data for TN45594: {'auction_closing_time': 1774883916.0, 'created_time': 1774699870.809288, 'last_price_update_time': 1774873828.297714}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN45594') HTTP/1.1" 204 0
2026-03-30 12:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.nl] INFO: Scrape type for HK48702: 0
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.nl] INFO: Scrape type for PX89333: 0
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.nl] INFO: Scrape type for JM32164: 2
2026-03-30 12:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-30 12:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe, identifier: JM32164
2026-03-30 12:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-30 12:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-30 12:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164 to the API
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'diesel',
 'id': '1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM32164',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 178774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-17',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2014}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.nl] INFO: Saving data for JM32164: {'auction_closing_time': 1774885963.0, 'created_time': 1774699851.147475, 'last_price_update_time': 1774873828.852599}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM32164') HTTP/1.1" 204 0
2026-03-30 12:30:28 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.nl] INFO: Scrape type for HM06318: 2
2026-03-30 12:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-30 12:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ccd898-0669-55ff-92da-5fac068ba1c4 with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52ccd898-0669-55ff-92da-5fac068ba1c4 with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 52ccd898-0669-55ff-92da-5fac068ba1c4, identifier: HM06318
2026-03-30 12:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-30 12:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-30 12:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318 to the API
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 514,
 'expiration_date': '2026-03-30T15:53:17Z',
 'fuel_type': 'electro',
 'id': '52ccd898-0669-55ff-92da-5fac068ba1c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM06318',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 112245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seller_name': None,
 'title': 'Tesla Model Y Max Range Dual AWD AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2022}
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-30 12:30:29 [auto1.nl] INFO: Saving data for HM06318: {'auction_closing_time': 1774885997.0, 'created_time': 1774699881.914954, 'last_price_update_time': 1774873829.304028}
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM06318') HTTP/1.1" 204 0
2026-03-30 12:30:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.776(s), this was the 1st time calling it.
2026-03-30 12:30:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.891050565852467 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:30:29 [auto1.nl] INFO: Channel: 24h | Page: 25 | totalHits: 1035 | hits on page: 40
2026-03-30 12:30:29 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-30 12:30:29 [auto1.nl] INFO: Scrape type for KH60865: 2
2026-03-30 12:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-30 12:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with scrape type 2
2026-03-30 12:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with scrape type 2
2026-03-30 12:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 35cd0ea0-88b0-5bb6-bb50-23592071ea99, identifier: KH60865
2026-03-30 12:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-30 12:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-30 12:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865 to the API
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:38Z',
 'fuel_type': 'diesel',
 'id': '35cd0ea0-88b0-5bb6-bb50-23592071ea99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH60865',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 319669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-02',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.nl] INFO: Saving data for KH60865: {'auction_closing_time': 1774884938.0, 'created_time': 1774699881.561968, 'last_price_update_time': 1774873830.994422}
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH60865') HTTP/1.1" 204 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for HG71940: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for MV57262: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for VS29188: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for ZZ45478: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for RW57039: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for HM15601: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for GP36316: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for UE83954: 2
2026-03-30 12:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-30 12:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with scrape type 2
2026-03-30 12:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with scrape type 2
2026-03-30 12:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355, identifier: UE83954
2026-03-30 12:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for GS42620: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for YJ91466: 0
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-30 12:30:31 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.nl] INFO: Scrape type for PA65227: 2
2026-03-30 12:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-30 12:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07038d-6030-54c4-8294-d15ea6a252ea with scrape type 2
2026-03-30 12:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e07038d-6030-54c4-8294-d15ea6a252ea with scrape type 2
2026-03-30 12:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e07038d-6030-54c4-8294-d15ea6a252ea, identifier: PA65227
2026-03-30 12:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-30 12:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-30 12:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954 to the API
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 470,
 'expiration_date': '2026-03-30T15:05:52Z',
 'fuel_type': 'electro',
 'id': '82d1f1ee-93e1-5933-a02b-8dad2d0d8355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE83954',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model X',
 'odometer': 299370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Tesla Model X 100D Dual',
 'transmission': 'automatic',
 'trim': 'Dual',
 'year': 2018}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.nl] INFO: Saving data for UE83954: {'auction_closing_time': 1774883152.0, 'created_time': 1774699873.029483, 'last_price_update_time': 1774873832.059364}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE83954') HTTP/1.1" 204 0
2026-03-30 12:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 12:30:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-30 12:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227 to the API
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:11:31Z',
 'fuel_type': 'electro',
 'id': '1e07038d-6030-54c4-8294-d15ea6a252ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA65227',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'eVito',
 'odometer': 82128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz eVito electric drive 85 kW lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2024}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.nl] INFO: Saving data for PA65227: {'auction_closing_time': 1774883491.0, 'created_time': 1774699849.036224, 'last_price_update_time': 1774873832.763041}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA65227') HTTP/1.1" 204 0
2026-03-30 12:30:32 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-30 12:30:32 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.nl] INFO: Scrape type for XG85677: 2
2026-03-30 12:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-30 12:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74da6829-81b5-54dc-a369-acff1d44363f with scrape type 2
2026-03-30 12:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74da6829-81b5-54dc-a369-acff1d44363f with scrape type 2
2026-03-30 12:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74da6829-81b5-54dc-a369-acff1d44363f, identifier: XG85677
2026-03-30 12:30:32 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-30 12:30:32 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-30 12:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-30 12:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-30 12:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677 to the API
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:54:52Z',
 'fuel_type': 'hybrid',
 'id': '74da6829-81b5-54dc-a369-acff1d44363f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG85677',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 185756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.nl] INFO: Saving data for XG85677: {'auction_closing_time': 1774886092.0, 'created_time': 1774699872.633596, 'last_price_update_time': 1774873833.204977}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG85677') HTTP/1.1" 204 0
2026-03-30 12:30:33 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-30 12:30:33 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.nl] INFO: Scrape type for SX97177: 2
2026-03-30 12:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-30 12:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d, identifier: SX97177
2026-03-30 12:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-30 12:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-30 12:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177 to the API
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:44:13Z',
 'fuel_type': 'diesel',
 'id': 'dd9da3f8-60c5-53cb-b2fd-c79459b82f5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX97177',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 338851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-06',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.nl] INFO: Saving data for SX97177: {'auction_closing_time': 1774885453.0, 'created_time': 1774699876.173328, 'last_price_update_time': 1774873833.613089}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX97177') HTTP/1.1" 204 0
2026-03-30 12:30:33 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-30 12:30:33 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-30 12:30:33 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.nl] INFO: Scrape type for PF57895: 2
2026-03-30 12:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-30 12:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item facf7e4a-cc13-5a68-a60c-79ce99195938 with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item facf7e4a-cc13-5a68-a60c-79ce99195938 with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: facf7e4a-cc13-5a68-a60c-79ce99195938, identifier: PF57895
2026-03-30 12:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-30 12:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-30 12:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895 to the API
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:27Z',
 'fuel_type': 'petrol',
 'id': 'facf7e4a-cc13-5a68-a60c-79ce99195938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF57895',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 104736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.nl] INFO: Saving data for PF57895: {'auction_closing_time': 1774884267.0, 'created_time': 1774699866.732402, 'last_price_update_time': 1774873834.058192}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PF57895') HTTP/1.1" 204 0
2026-03-30 12:30:34 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.nl] INFO: Scrape type for HV92208: 2
2026-03-30 12:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-30 12:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with scrape type 2
2026-03-30 12:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with scrape type 2
2026-03-30 12:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5, identifier: HV92208
2026-03-30 12:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-30 12:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-30 12:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208 to the API
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'petrol',
 'id': 'a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV92208',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 46843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-08',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2024}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.nl] INFO: Saving data for HV92208: {'auction_closing_time': 1774885985.0, 'created_time': 1774699849.651587, 'last_price_update_time': 1774873834.489066}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HV92208') HTTP/1.1" 204 0
2026-03-30 12:30:34 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.nl] INFO: Scrape type for WY33906: 2
2026-03-30 12:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-30 12:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2313a936-a8e6-5709-83cc-5140e234e2f4 with scrape type 2
2026-03-30 12:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2313a936-a8e6-5709-83cc-5140e234e2f4 with scrape type 2
2026-03-30 12:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2313a936-a8e6-5709-83cc-5140e234e2f4, identifier: WY33906
2026-03-30 12:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-30 12:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-30 12:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906 to the API
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'hybrid',
 'id': '2313a936-a8e6-5709-83cc-5140e234e2f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY33906',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 233495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-19',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line',
 'transmission': 'automatic',
 'trim': 'N Line',
 'year': 2021}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.nl] INFO: Saving data for WY33906: {'auction_closing_time': 1774882995.0, 'created_time': 1774699868.391582, 'last_price_update_time': 1774873834.912588}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY33906') HTTP/1.1" 204 0
2026-03-30 12:30:35 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.nl] INFO: Scrape type for WN49119: 2
2026-03-30 12:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-30 12:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a466afae-1dfc-5d72-990e-54c8afcbbf86 with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a466afae-1dfc-5d72-990e-54c8afcbbf86 with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a466afae-1dfc-5d72-990e-54c8afcbbf86, identifier: WN49119
2026-03-30 12:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-30 12:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-30 12:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119 to the API
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:27:51Z',
 'fuel_type': 'hybrid',
 'id': 'a466afae-1dfc-5d72-990e-54c8afcbbf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN49119',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 187001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.nl] INFO: Saving data for WN49119: {'auction_closing_time': 1774884471.0, 'created_time': 1774699848.527156, 'last_price_update_time': 1774873835.45287}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN49119') HTTP/1.1" 204 0
2026-03-30 12:30:35 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-30 12:30:35 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.nl] INFO: Scrape type for XM87869: 2
2026-03-30 12:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-30 12:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d54751-09fa-59ea-8510-0959d073654d with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d54751-09fa-59ea-8510-0959d073654d with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5d54751-09fa-59ea-8510-0959d073654d, identifier: XM87869
2026-03-30 12:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-30 12:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-30 12:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869 to the API
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:47:16Z',
 'fuel_type': 'petrol',
 'id': 'e5d54751-09fa-59ea-8510-0959d073654d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM87869',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 250938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-19',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.nl] INFO: Saving data for XM87869: {'auction_closing_time': 1774885636.0, 'created_time': 1774699839.09976, 'last_price_update_time': 1774873835.868586}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XM87869') HTTP/1.1" 204 0
2026-03-30 12:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:30:35 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-30 12:30:35 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.nl] INFO: Scrape type for FB82909: 2
2026-03-30 12:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-30 12:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4342915f-5ba8-550a-84d2-cde7b5252675 with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4342915f-5ba8-550a-84d2-cde7b5252675 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4342915f-5ba8-550a-84d2-cde7b5252675, identifier: FB82909
2026-03-30 12:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-30 12:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-30 12:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909 to the API
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:10:31Z',
 'fuel_type': 'petrol',
 'id': '4342915f-5ba8-550a-84d2-cde7b5252675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB82909',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 53781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-18',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop Star',
 'transmission': 'automatic',
 'trim': 'Pop Star',
 'year': 2018}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.nl] INFO: Saving data for FB82909: {'auction_closing_time': 1774883431.0, 'created_time': 1774699846.124418, 'last_price_update_time': 1774873836.272306}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB82909') HTTP/1.1" 204 0
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.nl] INFO: Scrape type for YX65431: 2
2026-03-30 12:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-30 12:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560dad57-a578-594f-b026-61aeb8198025 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 560dad57-a578-594f-b026-61aeb8198025 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 560dad57-a578-594f-b026-61aeb8198025, identifier: YX65431
2026-03-30 12:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-30 12:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-30 12:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431 to the API
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:10Z',
 'fuel_type': 'petrol',
 'id': '560dad57-a578-594f-b026-61aeb8198025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX65431',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 275185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-23',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.nl] INFO: Saving data for YX65431: {'auction_closing_time': 1774884790.0, 'created_time': 1774699834.962894, 'last_price_update_time': 1774873836.849454}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YX65431') HTTP/1.1" 204 0
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-30 12:30:36 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.nl] INFO: Scrape type for MZ74119: 2
2026-03-30 12:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-30 12:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c with scrape type 2
2026-03-30 12:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c with scrape type 2
2026-03-30 12:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ebba39ab-1cd4-54bf-94e1-c098c9f4099c, identifier: MZ74119
2026-03-30 12:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-30 12:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-30 12:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119 to the API
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:56:06Z',
 'fuel_type': 'diesel',
 'id': 'ebba39ab-1cd4-54bf-94e1-c098c9f4099c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ74119',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 256902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-05',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.nl] INFO: Saving data for MZ74119: {'auction_closing_time': 1774886166.0, 'created_time': 1774699840.822941, 'last_price_update_time': 1774873837.377437}
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ74119') HTTP/1.1" 204 0
2026-03-30 12:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP54166> (referer: https://www.auto1.com/v1/car-details-view/BP54166/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1f70d15-dc6a-5a76-a67f-9c0923b5bf74 with identifier: BP54166
2026-03-30 12:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74 with scrape type 1
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_34bf38773504e4e4b4ad1f0750c7ab47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_34bf38773504e4e4b4ad1f0750c7ab47.jpg not downloaded yet
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_4200ab402ac964ad9eaf4644108d88cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4200ab402ac964ad9eaf4644108d88cd.jpg not downloaded yet
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_4918d940694c40a5d1067a17d04e6e46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4918d940694c40a5d1067a17d04e6e46.jpg not downloaded yet
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_1b34249d0805cb09a56ccd17a968bf98.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_1b34249d0805cb09a56ccd17a968bf98.jpg not downloaded yet
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_2d05d50c3a093cfc83914c04ab24e490.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_2d05d50c3a093cfc83914c04ab24e490.jpg not downloaded yet
2026-03-30 12:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_34bf38773504e4e4b4ad1f0750c7ab47.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_2d05d50c3a093cfc83914c04ab24e490.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_1b34249d0805cb09a56ccd17a968bf98.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d602c110>
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_34bf38773504e4e4b4ad1f0750c7ab47.jpg') HTTP/1.1" 204 0
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_34bf38773504e4e4b4ad1f0750c7ab47.jpg saved to cache
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d600cd50>
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_2d05d50c3a093cfc83914c04ab24e490.jpg') HTTP/1.1" 204 0
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_2d05d50c3a093cfc83914c04ab24e490.jpg saved to cache
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60a7a90>
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_1b34249d0805cb09a56ccd17a968bf98.jpg') HTTP/1.1" 204 0
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_1b34249d0805cb09a56ccd17a968bf98.jpg saved to cache
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74
2026-03-30 12:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4200ab402ac964ad9eaf4644108d88cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4918d940694c40a5d1067a17d04e6e46.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d6a87f90>
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_4200ab402ac964ad9eaf4644108d88cd.jpg') HTTP/1.1" 204 0
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4200ab402ac964ad9eaf4644108d88cd.jpg saved to cache
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc9d60c3a90>
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb5%252Fa9b5ca47b5b72d8c9a90f5e732fc7759%252Fpa%252FBP54166_4918d940694c40a5d1067a17d04e6e46.jpg') HTTP/1.1" 204 0
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4918d940694c40a5d1067a17d04e6e46.jpg saved to cache
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74
2026-03-30 12:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1f70d15-dc6a-5a76-a67f-9c0923b5bf74, skipping ID generation
2026-03-30 12:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74 with scrape type 1
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1f70d15-dc6a-5a76-a67f-9c0923b5bf74 sending to next pipeline
2026-03-30 12:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e1f70d15-dc6a-5a76-a67f-9c0923b5bf74, identifier: BP54166
2026-03-30 12:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e1f70d15-dc6a-5a76-a67f-9c0923b5bf74 with identifier: BP54166
2026-03-30 12:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e1f70d15-dc6a-5a76-a67f-9c0923b5bf74 with identifier: BP54166
2026-03-30 12:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e1f70d15-dc6a-5a76-a67f-9c0923b5bf74 with identifier: BP54166 to the API
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4918d940694c40a5d1067a17d04e6e46.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:19:55Z',
 'fuel_type': 'petrol',
 'id': 'e1f70d15-dc6a-5a76-a67f-9c0923b5bf74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '90JZBP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP54166',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 112610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_34bf38773504e4e4b4ad1f0750c7ab47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4200ab402ac964ad9eaf4644108d88cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_4918d940694c40a5d1067a17d04e6e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_1b34249d0805cb09a56ccd17a968bf98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f70d15-dc6a-5a76-a67f-9c0923b5bf74/e1f70d15-dc6a-5a76-a67f-9c0923b5bf74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b5/a9b5ca47b5b72d8c9a90f5e732fc7759/pa/BP54166_2d05d50c3a093cfc83914c04ab24e490.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2002}
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP54166%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.nl] INFO: Saving data for BP54166: {'created_time': 1774873841.467566, 'last_price_update_time': 1774873841.467579, 'auction_closing_time': 1774970395.0}
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP54166') HTTP/1.1" 204 0
2026-03-30 12:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:41 [auto1.nl] INFO: Channel: 24h | Page: 26 | totalHits: 1035 | hits on page: 35
2026-03-30 12:30:41 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-30 12:30:41 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.nl] INFO: Scrape type for GW58352: 2
2026-03-30 12:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-30 12:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with scrape type 2
2026-03-30 12:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with scrape type 2
2026-03-30 12:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c, identifier: GW58352
2026-03-30 12:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-30 12:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-30 12:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352 to the API
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:26:12Z',
 'fuel_type': 'petrol',
 'id': '8092a7e4-d46c-56b9-adfc-9f19a63dd41c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW58352',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 106180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.nl] INFO: Saving data for GW58352: {'auction_closing_time': 1774884372.0, 'created_time': 1774699832.219375, 'last_price_update_time': 1774873842.150559}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW58352') HTTP/1.1" 204 0
2026-03-30 12:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:42 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.nl] INFO: Scrape type for JB09830: 2
2026-03-30 12:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-30 12:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1edba11a-c0b2-5440-bb87-ac751f84ffa8, identifier: JB09830
2026-03-30 12:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-30 12:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-30 12:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830 to the API
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'electro',
 'id': '1edba11a-c0b2-5440-bb87-ac751f84ffa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB09830',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 156843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2021}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.nl] INFO: Saving data for JB09830: {'auction_closing_time': 1774883761.0, 'created_time': 1773904222.46797, 'last_price_update_time': 1774873842.653355}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB09830') HTTP/1.1" 204 0
2026-03-30 12:30:42 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.nl] INFO: Scrape type for CY78777: 2
2026-03-30 12:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-30 12:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e205ab4-26b7-517e-a4bf-5cd859a04f47, identifier: CY78777
2026-03-30 12:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-30 12:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-30 12:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777 to the API
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:44:52Z',
 'fuel_type': 'petrol',
 'id': '0e205ab4-26b7-517e-a4bf-5cd859a04f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY78777',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 156543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Exklusiv',
 'transmission': 'manual',
 'trim': 'Exklusiv',
 'year': 2015}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.nl] INFO: Saving data for CY78777: {'auction_closing_time': 1774885492.0, 'created_time': 1774699833.047819, 'last_price_update_time': 1774873843.077258}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY78777') HTTP/1.1" 204 0
2026-03-30 12:30:43 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-30 12:30:43 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-30 12:30:43 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.nl] INFO: Scrape type for CD19489: 2
2026-03-30 12:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-30 12:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a, identifier: CD19489
2026-03-30 12:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-30 12:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-30 12:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489 to the API
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'hybrid',
 'id': 'b98dca43-a229-54a0-a3f5-ed30d4ca8d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD19489',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 140826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-02',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.nl] INFO: Saving data for CD19489: {'auction_closing_time': 1774884721.0, 'created_time': 1773429050.698539, 'last_price_update_time': 1774873843.489919}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CD19489') HTTP/1.1" 204 0
2026-03-30 12:30:43 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.nl] INFO: Scrape type for DL13637: 2
2026-03-30 12:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-30 12:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6d8bb91-00f7-5269-8245-353e68c0a4b7 with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6d8bb91-00f7-5269-8245-353e68c0a4b7 with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f6d8bb91-00f7-5269-8245-353e68c0a4b7, identifier: DL13637
2026-03-30 12:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-30 12:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-30 12:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637 to the API
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:17:04Z',
 'fuel_type': 'petrol',
 'id': 'f6d8bb91-00f7-5269-8245-353e68c0a4b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL13637',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 300062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.nl] INFO: Saving data for DL13637: {'auction_closing_time': 1774883824.0, 'created_time': 1774699833.720753, 'last_price_update_time': 1774873843.958416}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DL13637') HTTP/1.1" 204 0
2026-03-30 12:30:43 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.nl] INFO: Scrape type for RY80321: 2
2026-03-30 12:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-30 12:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53762ab1-1094-5a33-9bbb-cfe686d3a64a with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53762ab1-1094-5a33-9bbb-cfe686d3a64a with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 53762ab1-1094-5a33-9bbb-cfe686d3a64a, identifier: RY80321
2026-03-30 12:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-30 12:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-30 12:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321 to the API
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:05:41Z',
 'fuel_type': 'diesel',
 'id': '53762ab1-1094-5a33-9bbb-cfe686d3a64a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY80321',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 289995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2014}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.nl] INFO: Saving data for RY80321: {'auction_closing_time': 1774883141.0, 'created_time': 1774699835.913988, 'last_price_update_time': 1774873844.385072}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY80321') HTTP/1.1" 204 0
2026-03-30 12:30:44 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-30 12:30:44 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.nl] INFO: Scrape type for KC04488: 2
2026-03-30 12:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-30 12:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af6988aa-27fb-518d-a792-2f321a99c71f with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af6988aa-27fb-518d-a792-2f321a99c71f with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: af6988aa-27fb-518d-a792-2f321a99c71f, identifier: KC04488
2026-03-30 12:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-30 12:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-30 12:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488 to the API
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:35:56Z',
 'fuel_type': 'petrol',
 'id': 'af6988aa-27fb-518d-a792-2f321a99c71f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC04488',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 153034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-10',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Play',
 'transmission': 'manual',
 'trim': 'X-Play',
 'year': 2016}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.nl] INFO: Saving data for KC04488: {'auction_closing_time': 1774884956.0, 'created_time': 1774034001.440451, 'last_price_update_time': 1774873844.905579}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC04488') HTTP/1.1" 204 0
2026-03-30 12:30:44 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.nl] INFO: Scrape type for SK13348: 2
2026-03-30 12:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-30 12:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4be411-cd89-5d76-bf40-b04fee70a927 with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a4be411-cd89-5d76-bf40-b04fee70a927 with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3a4be411-cd89-5d76-bf40-b04fee70a927, identifier: SK13348
2026-03-30 12:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-30 12:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-30 12:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348 to the API
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:06:11Z',
 'fuel_type': 'petrol',
 'id': '3a4be411-cd89-5d76-bf40-b04fee70a927',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK13348',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-30',
 'seller_name': None,
 'title': 'BMW 3er 318i Edition Exclusive',
 'transmission': 'automatic',
 'trim': 'Edition Exclusive',
 'year': 2004}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.nl] INFO: Saving data for SK13348: {'auction_closing_time': 1774883171.0, 'created_time': 1774699856.575664, 'last_price_update_time': 1774873845.333194}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SK13348') HTTP/1.1" 204 0
2026-03-30 12:30:45 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.nl] INFO: Scrape type for JB39700: 2
2026-03-30 12:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-30 12:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02af6e8a-f01d-5d65-a501-61c7afbe6337 with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02af6e8a-f01d-5d65-a501-61c7afbe6337 with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02af6e8a-f01d-5d65-a501-61c7afbe6337, identifier: JB39700
2026-03-30 12:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-30 12:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-30 12:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700 to the API
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'petrol',
 'id': '02af6e8a-f01d-5d65-a501-61c7afbe6337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB39700',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 154505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-30',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.nl] INFO: Saving data for JB39700: {'auction_closing_time': 1774883052.0, 'created_time': 1774699844.170694, 'last_price_update_time': 1774873845.763039}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB39700') HTTP/1.1" 204 0
2026-03-30 12:30:45 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.nl] INFO: Scrape type for NZ86515: 2
2026-03-30 12:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-30 12:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16, identifier: NZ86515
2026-03-30 12:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 12:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-30 12:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515 to the API
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:01:12Z',
 'fuel_type': 'petrol',
 'id': '8f083ca3-4849-5d2d-bb2b-de72c97f2e16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ86515',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 107063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-17',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.nl] INFO: Saving data for NZ86515: {'auction_closing_time': 1774882872.0, 'created_time': 1774699848.100193, 'last_price_update_time': 1774873846.388065}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ86515') HTTP/1.1" 204 0
2026-03-30 12:30:46 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-30 12:30:46 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-30 12:30:46 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-30 12:30:46 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-30 12:30:46 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-30 12:30:46 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.nl] INFO: Scrape type for WK03460: 2
2026-03-30 12:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-30 12:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4384629a-9755-541c-83b9-7bc1cdb64060 with scrape type 2
2026-03-30 12:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4384629a-9755-541c-83b9-7bc1cdb64060 with scrape type 2
2026-03-30 12:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4384629a-9755-541c-83b9-7bc1cdb64060, identifier: WK03460
2026-03-30 12:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-30 12:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-30 12:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460 to the API
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:32Z',
 'fuel_type': 'petrol',
 'id': '4384629a-9755-541c-83b9-7bc1cdb64060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK03460',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 285326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.nl] INFO: Saving data for WK03460: {'auction_closing_time': 1774884212.0, 'created_time': 1774699857.430934, 'last_price_update_time': 1774873846.846895}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK03460') HTTP/1.1" 204 0
2026-03-30 12:30:46 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.nl] INFO: Scrape type for FG02230: 2
2026-03-30 12:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-30 12:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e94fe0-a429-51cb-a874-beabf2585ea2 with scrape type 2
2026-03-30 12:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64e94fe0-a429-51cb-a874-beabf2585ea2 with scrape type 2
2026-03-30 12:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64e94fe0-a429-51cb-a874-beabf2585ea2, identifier: FG02230
2026-03-30 12:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-30 12:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-30 12:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230 to the API
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:21Z',
 'fuel_type': 'petrol',
 'id': '64e94fe0-a429-51cb-a874-beabf2585ea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG02230',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 178651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-26',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-30 12:30:47 [auto1.nl] INFO: Saving data for FG02230: {'auction_closing_time': 1774885701.0, 'created_time': 1774699844.5519, 'last_price_update_time': 1774873847.344514}
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FG02230') HTTP/1.1" 204 0
2026-03-30 12:30:47 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-30 12:30:47 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-30 12:30:47 [auto1.nl] INFO: Scrape type for NX59327: 2
2026-03-30 12:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-30 12:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with scrape type 2
2026-03-30 12:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with scrape type 2
2026-03-30 12:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0, identifier: NX59327
2026-03-30 12:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-30 12:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-30 12:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327 to the API
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:15:23Z',
 'fuel_type': 'petrol',
 'id': '9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX59327',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 83312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2016}
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-30 12:30:47 [auto1.nl] INFO: Saving data for NX59327: {'auction_closing_time': 1774883723.0, 'created_time': 1774699845.748042, 'last_price_update_time': 1774873847.746794}
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX59327') HTTP/1.1" 204 0
2026-03-30 12:30:47 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-30 12:30:47 [auto1.nl] INFO: Scrape type for AB36156: 2
2026-03-30 12:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-30 12:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with scrape type 2
2026-03-30 12:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with scrape type 2
2026-03-30 12:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f, identifier: AB36156
2026-03-30 12:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-30 12:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-30 12:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156 to the API
2026-03-30 12:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:32:57Z',
 'fuel_type': 'petrol',
 'id': 'f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB36156',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 213258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-23',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2005}
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-30 12:30:48 [auto1.nl] INFO: Saving data for AB36156: {'auction_closing_time': 1774884777.0, 'created_time': 1774699843.305749, 'last_price_update_time': 1774873848.141896}
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB36156') HTTP/1.1" 204 0
2026-03-30 12:30:48 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-30 12:30:48 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-30 12:30:48 [auto1.nl] INFO: Scrape type for JW97628: 2
2026-03-30 12:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-30 12:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with scrape type 2
2026-03-30 12:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with scrape type 2
2026-03-30 12:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253, identifier: JW97628
2026-03-30 12:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-30 12:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-30 12:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628 to the API
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 162,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'petrol',
 'id': '4bf3e8cb-800f-53ec-9b70-964ffd7eb253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW97628',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Sonata',
 'odometer': 281747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-07',
 'seller_name': None,
 'title': 'Hyundai Sonata 2.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2005}
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-30 12:30:48 [auto1.nl] INFO: Saving data for JW97628: {'auction_closing_time': 1774885795.0, 'created_time': 1774699867.662163, 'last_price_update_time': 1774873848.527077}
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW97628') HTTP/1.1" 204 0
2026-03-30 12:30:48 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-30 12:30:48 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-30 12:30:48 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-30 12:30:48 [auto1.nl] INFO: Scrape type for LR40141: 2
2026-03-30 12:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-30 12:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1209bd14-ac06-5df4-9618-dcc22a134f1f with scrape type 2
2026-03-30 12:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1209bd14-ac06-5df4-9618-dcc22a134f1f with scrape type 2
2026-03-30 12:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1209bd14-ac06-5df4-9618-dcc22a134f1f, identifier: LR40141
2026-03-30 12:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-30 12:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-30 12:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141 to the API
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:50:00Z',
 'fuel_type': 'petrol',
 'id': '1209bd14-ac06-5df4-9618-dcc22a134f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR40141',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 139943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-30 12:30:48 [auto1.nl] INFO: Saving data for LR40141: {'auction_closing_time': 1774885800.0, 'created_time': 1774699861.487774, 'last_price_update_time': 1774873848.913339}
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LR40141') HTTP/1.1" 204 0
2026-03-30 12:30:48 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-30 12:30:48 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-30 12:30:48 [auto1.nl] INFO: Scrape type for EP93197: 2
2026-03-30 12:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-30 12:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with scrape type 2
2026-03-30 12:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with scrape type 2
2026-03-30 12:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072, identifier: EP93197
2026-03-30 12:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-30 12:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-30 12:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197 to the API
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:16Z',
 'fuel_type': 'petrol',
 'id': '7c4f38ad-0cf0-5e8d-a429-4516e62c5072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP93197',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 203514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2020}
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.nl] INFO: Saving data for EP93197: {'auction_closing_time': 1774884616.0, 'created_time': 1774699861.917669, 'last_price_update_time': 1774873849.311514}
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP93197') HTTP/1.1" 204 0
2026-03-30 12:30:49 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.nl] INFO: Scrape type for DT42929: 2
2026-03-30 12:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-30 12:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d6700a-f12c-548c-997f-97f1bcf08383 with scrape type 2
2026-03-30 12:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15d6700a-f12c-548c-997f-97f1bcf08383 with scrape type 2
2026-03-30 12:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 15d6700a-f12c-548c-997f-97f1bcf08383, identifier: DT42929
2026-03-30 12:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-30 12:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-30 12:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929 to the API
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:55:13Z',
 'fuel_type': 'diesel',
 'id': '15d6700a-f12c-548c-997f-97f1bcf08383',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT42929',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 237956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 10 SX L1H1 130 Multijet',
 'transmission': 'manual',
 'trim': '10 SX L1H1 130 Multijet',
 'year': 2012}
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-30 12:30:50 [auto1.nl] INFO: Saving data for DT42929: {'auction_closing_time': 1774886113.0, 'created_time': 1774033942.229374, 'last_price_update_time': 1774873850.05611}
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT42929') HTTP/1.1" 204 0
2026-03-30 12:30:50 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-30 12:30:50 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-30 12:30:50 [auto1.nl] INFO: Scrape type for AV73218: 2
2026-03-30 12:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218
2026-03-30 12:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857eb26d-7aa9-5141-aa32-329febaa3696 with scrape type 2
2026-03-30 12:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 857eb26d-7aa9-5141-aa32-329febaa3696 with scrape type 2
2026-03-30 12:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 857eb26d-7aa9-5141-aa32-329febaa3696, identifier: AV73218
2026-03-30 12:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218
2026-03-30 12:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218
2026-03-30 12:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218 to the API
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:10:57Z',
 'fuel_type': 'petrol',
 'id': '857eb26d-7aa9-5141-aa32-329febaa3696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV73218',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 291523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-07',
 'seller_name': None,
 'title': 'Volvo V70 2.0 T Edition R-Design',
 'transmission': 'manual',
 'trim': 'Edition R-Design',
 'year': 2010}
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-30 12:30:50 [auto1.nl] INFO: Saving data for AV73218: {'auction_closing_time': 1774883457.0, 'created_time': 1773405067.077954, 'last_price_update_time': 1774873850.96456}
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AV73218') HTTP/1.1" 204 0
2026-03-30 12:30:50 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-30 12:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:51 [auto1.nl] INFO: Channel: 24h | Page: 27 | totalHits: 1035 | hits on page: 0
2026-03-30 12:30:51 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 12:30:51 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-30 12:30:51 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 2}
2026-03-30 12:30:51 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (227 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-30T12_10_00.jl
2026-03-30 12:30:51 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 858515,
 'downloader/request_count': 476,
 'downloader/request_method_count/GET': 447,
 'downloader/request_method_count/POST': 29,
 'downloader/response_bytes': 252422331,
 'downloader/response_count': 476,
 'downloader/response_status_count/200': 476,
 'dupefilter/filtered': 12,
 'elapsed_time_seconds': 1244.098818,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 12, 30, 51, 184948, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 227,
 'log_count/DEBUG': 5903,
 'log_count/INFO': 6051,
 'log_count/WARNING': 2,
 'memusage/max': 187539456,
 'memusage/startup': 147787776,
 'photo_download_count': 317,
 'request_depth_max': 30,
 'response_received_count': 159,
 'scheduler/dequeued': 476,
 'scheduler/dequeued/memory': 476,
 'scheduler/enqueued': 476,
 'scheduler/enqueued/memory': 476,
 'scrape_type/batch_skipped': 553,
 'scrape_type/new': 64,
 'scrape_type/price_update': 163,
 'scrape_type/skipped': 283,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 194,
 'scrapy-zyte-api/error_ratio': 0.18041237113402062,
 'scrapy-zyte-api/errors': 35,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 35,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 11.429367957610353,
 'scrapy-zyte-api/mean_response_seconds': 11.460681986497166,
 'scrapy-zyte-api/processed': 159,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 159,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 158,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 159,
 'scrapy-zyte-api/request_args/httpRequestBody': 29,
 'scrapy-zyte-api/request_args/httpRequestMethod': 29,
 'scrapy-zyte-api/request_args/httpResponseBody': 159,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 159,
 'scrapy-zyte-api/request_args/sessionContext': 159,
 'scrapy-zyte-api/request_args/url': 159,
 'scrapy-zyte-api/status_codes/0': 35,
 'scrapy-zyte-api/status_codes/200': 159,
 'scrapy-zyte-api/success': 159,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1075,
 'source/total_available': 1035,
 'start_time': datetime.datetime(2026, 3, 30, 12, 10, 7, 86130, tzinfo=datetime.timezone.utc)}
2026-03-30 12:30:51 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 12:30:51 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc9dc93e0d0>
2026-03-30 12:30:51 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc9dc93e7d0>